Jul 23 22:14:01 devstack cinder-volume[77326]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 23 22:14:01 devstack cinder-volume[77326]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 22:14:01 devstack cinder-volume[77326]: we strongly recommend against using it for new projects. Jul 23 22:14:01 devstack cinder-volume[77326]: If you are already using Eventlet, we recommend migrating to a different Jul 23 22:14:01 devstack cinder-volume[77326]: framework. For more detail see Jul 23 22:14:01 devstack cinder-volume[77326]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 22:14:01 devstack cinder-volume[77326]: import eventlet # noqa Jul 23 22:14:03 devstack cinder-volume[77326]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77326) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 22:14:03 devstack cinder-volume[77326]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77326) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 22:14:03 devstack cinder-volume[77326]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77326) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 22:14:04 devstack cinder-volume[77326]: INFO dbcounter [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Registered counter for database cinder Jul 23 22:14:05 devstack cinder-volume[77326]: DEBUG oslo_db.sqlalchemy.engines [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77326) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 22:14:05 devstack cinder-volume[77326]: DEBUG dbcounter [-] [77326] Writer thread running {{(pid=77326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 22:14:05 devstack cinder-volume[77326]: INFO cinder.rpc [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 23 22:14:05 devstack cinder-volume[77326]: INFO cinder.rpc [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 23 22:14:05 devstack cinder-volume[77326]: DEBUG oslo_db.sqlalchemy.engines [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77326) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 22:14:05 devstack cinder-volume[77326]: INFO cinder.volume.manager [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Determined volume DB was empty at startup. Jul 23 22:14:05 devstack cinder-volume[77326]: DEBUG cinder.volume.manager [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77326) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 23 22:14:05 devstack cinder-volume[77326]: INFO cinder.volume.manager [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 23 22:14:05 devstack cinder-volume[77326]: WARNING stevedore.named [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 22:14:05 devstack cinder-volume[77326]: WARNING castellan.key_manager [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 22:14:05 devstack cinder-volume[77326]: WARNING cinder.keymgr.conf_key_mgr [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 22:14:05 devstack cinder-volume[77326]: DEBUG cinder.volume.drivers.lvm [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77326) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 23 22:14:05 devstack cinder-volume[77326]: DEBUG oslo_concurrency.processutils [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:05 devstack cinder-volume[77326]: DEBUG oslo_concurrency.processutils [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] CMD "cinder-rtstool verify" returned: 0 in 0.416s {{(pid=77326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_db.sqlalchemy.engines [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77326) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 22:14:06 devstack cinder-volume[77326]: INFO cinder.rpc [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 23 22:14:06 devstack cinder-volume[77326]: INFO cinder.rpc [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 23 22:14:06 devstack cinder-volume[77326]: WARNING stevedore.named [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 22:14:06 devstack cinder-volume[77326]: WARNING castellan.key_manager [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 22:14:06 devstack cinder-volume[77326]: INFO cinder.volume.manager [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_db.sqlalchemy.engines [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77326) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 22:14:06 devstack cinder-volume[77326]: INFO oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Starting 1 workers Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Started child 77483 {{(pid=77326) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Full set of CONF: {{(pid=77326) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] ******************************************************************************** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Configuration options gathered from: {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] ================================================================================ {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 23 22:14:06 devstack cinder-volume[77483]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] allow_availability_zone_fallback = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] allow_compression_on_image_upload = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] allowed_direct_url_schemes = [] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] api_rate_limit = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] auth_strategy = keystone {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] az_cache_duration = 3600 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_availability_zone = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_host = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_name = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_stats_polling_interval = 60 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backup_api_class = cinder.backup.api.API {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backup_name_template = backup-%s {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backup_use_same_host = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backup_use_temp_snapshot = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] chap_password = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] chap_username = {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cinder_internal_tenant_project_id = fc5648ee755b4955a30d144ae4198a7a {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cinder_internal_tenant_user_id = a1c3712893644a3eb0b03cc386408ec5 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cloned_volume_same_az = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cluster = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] compression_format = gzip {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] compute_api_class = cinder.compute.nova.API {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] config_dir = [] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] config_source = [] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] control_exchange = openstack {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] debug = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] default_availability_zone = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] default_group_type = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] default_volume_type = lvmdriver-1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] disk_geometry = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] driver_client_cert = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] driver_client_cert_key = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] driver_data_namespace = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] driver_ssl_cert_path = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] driver_ssl_cert_verify = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] driver_use_ssl = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] enable_force_upload = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] enable_new_services = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] enable_unsupported_driver = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] enabled_backends = ['lvmdriver-1'] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] enforce_multipath_for_image_xfer = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] filter_function = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance_api_insecure = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance_api_servers = ['http://192.168.122.106/image'] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance_api_ssl_compression = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance_ca_certificates_file = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance_catalog_info = image:glance:publicURL {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance_certfile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance_keyfile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77483]: INFO cinder.volume.manager [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 23 22:14:06 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance_num_retries = 3 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance_request_timeout = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] goodness_function = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] graceful_shutdown_timeout = 5 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] group_api_class = cinder.group.api.API {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] host = devstack {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] image_compress_on_upload = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] image_conversion_address_space_limit = 1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] image_conversion_cpu_limit = 60 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] image_conversion_disable = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] image_upload_use_cinder_backend = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] image_upload_use_internal_tenant = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] image_volume_cache_enabled = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] image_volume_cache_max_count = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] image_volume_cache_max_size_gb = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] init_host_max_objects_retrieval = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] instance_format = [instance: %(uuid)s] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] iscsi_target_flags = {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] iscsi_write_cache = on {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] iser_helper = tgtadm {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] iser_ip_address = 192.168.122.106 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] iser_port = 3260 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] log_color = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] log_config_append = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] log_dir = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] log_file = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] log_options = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] log_rotate_interval = 1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] log_rotate_interval_type = days {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] log_rotation_type = none {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] max_age = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] max_logfile_count = 30 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] max_logfile_size_mb = 200 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] max_over_subscription_ratio = 20.0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] message_reap_interval = 86400 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] message_ttl = 2592000 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] migration_create_volume_timeout_secs = 300 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] monkey_patch = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] monkey_patch_modules = [] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] my_ip = 192.168.122.106 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] no_snapshot_gb_quota = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] num_iser_scan_tries = 3 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] num_shell_tries = 3 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] num_volume_device_scan_tries = 3 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] nvmeof_conn_info_version = 1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] nvmet_ns_id = 10 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] nvmet_port_id = 1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] osapi_max_limit = 1000 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] osapi_volume_ext_list = [] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] osapi_volume_listen = 0.0.0.0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] osapi_volume_listen_port = 8776 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] osapi_volume_use_ssl = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] osapi_volume_workers = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] per_volume_size_limit = -1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] periodic_fuzzy_delay = 60 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] periodic_interval = 60 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] project_id_regex = [0-9a-f\-]+ {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] public_endpoint = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] publish_errors = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] quota_backup_gigabytes = 1000 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] quota_backups = 10 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:06 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] quota_gigabytes = 1000 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] quota_groups = 10 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] quota_snapshots = 10 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] quota_volumes = 10 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] rate_limit_burst = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] rate_limit_except_level = CRITICAL {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] rate_limit_interval = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] reinit_driver_count = 3 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] replication_device = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] report_discard_supported = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] report_interval = 120 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] reservation_clean_interval = 86400 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] reservation_expire = 86400 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] reserved_image_namespaces = [] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] reserved_percentage = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] rpc_response_timeout = 120 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] run_external_periodic_tasks = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] scst_target_driver = iscsi {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] scst_target_iqn_name = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] service_down_time = 720 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] shell_completion = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] snapshot_name_template = snapshot-%s {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] snapshot_same_host = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] split_loggers = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] state_path = /opt/stack/data/cinder {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] storage_availability_zone = nova {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] storage_protocol = iSCSI {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] syslog_log_facility = LOG_USER {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] target_helper = lioadm {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] target_ip_address = 192.168.122.106 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] target_port = 3260 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] target_protocol = iscsi {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] target_secondary_ip_addresses = [] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] trace_flags = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] transfer_api_class = cinder.transfer.api.API {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] transport_url = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] until_refresh = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] use_chap_auth = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] use_default_quota_class = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] use_journal = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] use_json = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] use_multipath_for_image_xfer = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] use_stderr = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] use_syslog = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] verify_glance_signatures = enabled {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] volume_api_class = cinder.volume.api.API {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] volume_backend_name = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] volume_clear = zero {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] volume_clear_ionice = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] volume_clear_size = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] volume_copy_bps_limit = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] volume_dd_blocksize = 1M {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] volume_name_template = volume-%s {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] volume_service_inithost_offload = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] volume_usage_audit_period = month {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] zoning_mode = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_concurrency.disable_process_locking = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:06 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.auth_section = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.auth_type = password {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.auth_version = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.cache = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.certfile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.delay_auth_decision = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.http_connect_timeout = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.include_service_catalog = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.insecure = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.interface = public {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.keyfile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcache_password = {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcache_username = {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.region_name = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.service_token_roles_required = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.service_type = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.token_cache_time = 300 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.106/identity {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.backend = dogpile.cache.null {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.backend_argument = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.backend_expiration_time = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.config_prefix = cache.oslo {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.debug_cache_backend = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.enable_retry_client = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.enable_socket_keepalive = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.enabled = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.expiration_time = 600 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.hashclient_retry_attempts = 2 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.memcache_dead_retry = 300 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.memcache_pool_maxsize = 10 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.memcache_sasl_enabled = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.password = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.proxies = [] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.redis_db = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.redis_sentinel_service_name = mymaster {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.redis_server = localhost:6379 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.retry_attempts = 2 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.retry_delay = 0.0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.socket_keepalive_count = 1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.socket_keepalive_idle = 1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.socket_keepalive_interval = 1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.socket_timeout = 1.0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.tls_allowed_ciphers = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.tls_cafile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.tls_certfile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.tls_enabled = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.tls_keyfile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cache.username = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] coordination.backend_url = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.asyncio_connection = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.asyncio_slave_connection = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.backend = sqlalchemy {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.connection = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.connection_debug = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.connection_parameters = {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.connection_recycle_time = 3600 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.connection_trace = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.db_inc_retry_interval = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.db_max_retries = 20 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.db_max_retry_interval = 10 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:06 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.db_retry_interval = 1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.max_overflow = 50 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.max_pool_size = 5 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.max_retries = 10 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.mysql_wsrep_sync_wait = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.pool_timeout = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.retry_interval = 10 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.slave_connection = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.sqlite_synchronous = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.synchronous_reader = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] database.use_db_reconnect = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] profiler.connection_string = messaging:// {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] profiler.enabled = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] profiler.es_doc_type = notification {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] profiler.es_scroll_size = 10000 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] profiler.es_scroll_time = 2m {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] profiler.filter_error_trace = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] profiler.hmac_keys = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] profiler.sentinel_service_name = mymaster {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] profiler.socket_timeout = 0.1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] profiler.trace_requests = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] profiler.trace_sqlalchemy = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] profiler_jaeger.process_tags = {} {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] profiler_jaeger.service_name_prefix = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] profiler_otlp.service_name_prefix = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_policy.enforce_new_defaults = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_policy.policy_default_rule = default {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_policy.policy_file = policy.yaml {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_policy.remote_timeout = 60.0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] privsep_osbrick.group = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] privsep_osbrick.helper_command = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] privsep_osbrick.user = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cinder_sys_admin.group = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cinder_sys_admin.helper_command = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] cinder_sys_admin.user = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] service_user.auth_section = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] service_user.auth_type = password {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] service_user.cafile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] service_user.certfile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] service_user.collect_timing = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] service_user.insecure = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] service_user.keyfile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] service_user.send_service_user_token = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] service_user.split_loggers = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] service_user.timeout = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance.auth_section = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance.auth_type = password {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance.certfile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance.collect_timing = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance.insecure = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance.keyfile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance.region_name = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance.split_loggers = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] glance.timeout = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.backend_availability_zone = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.chap_password = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.chap_username = {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack sudo[77488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.disk_geometry = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.driver_client_cert = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.driver_client_cert_key = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.driver_data_namespace = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack sudo[77488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.driver_use_ssl = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.enable_unsupported_driver = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.extra_capabilities = {} {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.filter_function = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.goodness_function = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.iscsi_target_flags = {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.iscsi_write_cache = on {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.iser_helper = tgtadm {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.iser_ip_address = 192.168.122.106 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.iser_port = 3260 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.lvm_mirrors = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.lvm_share_target = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.lvm_type = auto {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.num_shell_tries = 3 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.nvmet_port_id = 1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.replication_device = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.report_discard_supported = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.reserved_percentage = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.scst_target_driver = iscsi {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.scst_target_iqn_name = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.storage_protocol = iSCSI {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.target_helper = tgtadm {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.target_ip_address = 192.168.122.106 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.target_port = 3260 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.target_protocol = iscsi {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.trace_flags = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.unique_fqdn_network = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.use_chap_auth = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.volume_backend_name = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.volume_clear = zero {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.volume_clear_ionice = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.volume_clear_size = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.volume_group = cinder-volumes {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_reports.file_event_handler = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_reports.log_dir = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.backend_availability_zone = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.backend_host = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.chap_password = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.chap_username = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.chiscsi_conf = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.disk_geometry = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.driver_client_cert = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.driver_data_namespace = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.driver_use_ssl = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.extra_capabilities = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.filter_function = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.goodness_function = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.iser_helper = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.iser_ip_address = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.iser_port = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.iser_target_prefix = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.lvm_conf_file = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.lvm_mirrors = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.lvm_share_target = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.lvm_type = auto {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.num_shell_tries = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.nvmet_port_id = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.replication_device = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.report_discard_supported = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.reserved_percentage = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.scst_target_driver = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.storage_protocol = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.target_helper = lioadm {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.target_ip_address = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.target_port = 3260 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.target_protocol = iscsi {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.trace_flags = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.use_chap_auth = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.volume_clear = zero {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.volume_clear_size = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] lvmdriver-1.volumes_dir = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.ssl = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.ssl_version = {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_notifications.driver = [] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_notifications.retry = -1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] oslo_messaging_notifications.transport_url = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] key_manager.fixed_key = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.barbican_api_version = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.barbican_endpoint = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.barbican_endpoint_type = public {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.barbican_region_name = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.cafile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.certfile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.collect_timing = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.insecure = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.keyfile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.number_of_retries = 60 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.retry_delay = 1 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.send_service_user_token = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.split_loggers = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.timeout = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.verify_ssl = True {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican.verify_ssl_path = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican_service_user.auth_section = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican_service_user.auth_type = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican_service_user.cafile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican_service_user.certfile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican_service_user.collect_timing = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican_service_user.insecure = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican_service_user.keyfile = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican_service_user.split_loggers = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] barbican_service_user.timeout = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] vault.approle_role_id = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] vault.approle_secret_id = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] vault.auth_method = approle {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] vault.auth_path = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] vault.kv_mountpoint = secret {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] vault.kv_path = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] vault.kv_version = 2 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] vault.namespace = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] vault.root_token_id = **** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] vault.ssl_ca_crt_file = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] vault.timeout = 60.0 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] vault.token_file = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] vault.token_role = None {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] vault.use_ssl = False {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:14:06 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] ******************************************************************************** {{(pid=77326) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 23 22:14:06 devstack sudo[77488]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:06 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.390s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:06 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:06 devstack sudo[77587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 22:14:06 devstack sudo[77587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:07 devstack sudo[77587]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:07 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.286s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:07 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:14:07 devstack cinder-volume[77483]: INFO cinder.brick.local_dev.lvm [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 23 22:14:07 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:07 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:07 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:07 devstack sudo[77686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 22:14:07 devstack sudo[77686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:07 devstack sudo[77686]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:07 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:07 devstack cinder-volume[77483]: DEBUG cinder.brick.local_dev.lvm [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77483) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 23 22:14:07 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:07 devstack sudo[77774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 22:14:07 devstack sudo[77774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:07 devstack sudo[77774]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:07 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.495s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:07 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:07 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:07 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:07 devstack sudo[77969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 22:14:07 devstack sudo[77969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:08 devstack sudo[77969]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:08 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:08 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:08 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:08 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:08 devstack sudo[78095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 23 22:14:08 devstack sudo[78095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:08 devstack sudo[78095]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:08 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.261s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:08 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:08 devstack sudo[78098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 22:14:08 devstack sudo[78098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:08 devstack sudo[78098]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:08 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:08 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:08 devstack sudo[78181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 22:14:08 devstack sudo[78181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:09 devstack sudo[78181]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:09 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:09 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:09 devstack sudo[78184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 22:14:09 devstack sudo[78184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:09 devstack sudo[78184]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:09 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:09 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:09 devstack sudo[78203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 22:14:09 devstack sudo[78203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:09 devstack sudo[78203]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:09 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.356s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:09 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:09 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:09 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:09 devstack sudo[78283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 22:14:09 devstack sudo[78283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:10 devstack sudo[78283]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:10 devstack cinder-volume[77483]: INFO cinder.volume.drivers.lvm [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 23 22:14:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:10 devstack sudo[78287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 22:14:10 devstack sudo[78287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:10 devstack sudo[78287]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:10 devstack cinder-volume[77483]: DEBUG cinder.volume.drivers.lvm [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Updating volume stats {{(pid=77483) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 22:14:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:10 devstack sudo[78290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 22:14:10 devstack sudo[78290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:10 devstack sudo[78290]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:10 devstack sudo[78293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 22:14:10 devstack sudo[78293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:10 devstack sudo[78293]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:10 devstack sudo[78296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 22:14:10 devstack sudo[78296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:11 devstack sudo[78296]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:11 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:11 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:11 devstack sudo[78299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 22:14:11 devstack sudo[78299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:11 devstack sudo[78299]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:11 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:11 devstack cinder-volume[77483]: INFO cinder.volume.driver [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Driver hasn't implemented _init_vendor_properties() Jul 23 22:14:11 devstack cinder-volume[77483]: DEBUG cinder.volume.driver [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77483) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 23 22:14:11 devstack cinder-volume[77483]: DEBUG oslo_db.sqlalchemy.engines [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77483) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 22:14:11 devstack cinder-volume[77483]: DEBUG dbcounter [-] [77483] Writer thread running {{(pid=77483) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 22:14:11 devstack cinder-volume[77483]: DEBUG cinder.db.api [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Building query based on filter {{(pid=77483) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 23 22:14:11 devstack cinder-volume[77483]: DEBUG cinder.image.image_utils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77483) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 23 22:14:11 devstack cinder-volume[77483]: INFO cinder.keymgr.migration [None req-6b9b7f4b-9e48-406d-b4c9-30503df273aa None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 23 22:14:11 devstack cinder-volume[77483]: DEBUG cinder.volume.drivers.lvm [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Updating volume stats {{(pid=77483) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 22:14:11 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:11 devstack sudo[78302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 22:14:11 devstack sudo[78302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:11 devstack sudo[78302]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:11 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:11 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:11 devstack sudo[78307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 22:14:11 devstack sudo[78307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:12 devstack sudo[78307]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:12 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:12 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:12 devstack sudo[78310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 22:14:12 devstack sudo[78310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:12 devstack sudo[78310]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:12 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:12 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:12 devstack sudo[78314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 22:14:12 devstack sudo[78314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:12 devstack sudo[78314]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:12 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:12 devstack cinder-volume[77483]: DEBUG cinder.manager [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Notifying Schedulers of capabilities ... {{(pid=77483) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:14:12 devstack cinder-volume[77483]: INFO cinder.volume.manager [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Driver initialization completed successfully. Jul 23 22:14:12 devstack cinder-volume[77483]: INFO cinder.manager [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Initiating service 2 cleanup Jul 23 22:14:12 devstack cinder-volume[77483]: INFO cinder.manager [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Service 2 cleanup completed. Jul 23 22:14:12 devstack cinder-volume[77483]: DEBUG cinder.service [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Creating RPC server for service cinder-volume {{(pid=77483) start /opt/stack/cinder/cinder/service.py:231}} Jul 23 22:14:12 devstack cinder-volume[77483]: DEBUG cinder.service [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77483) start /opt/stack/cinder/cinder/service.py:237}} Jul 23 22:14:12 devstack cinder-volume[77483]: INFO cinder.volume.manager [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 23 22:14:12 devstack cinder-volume[77483]: DEBUG cinder.volume.drivers.lvm [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Updating volume stats {{(pid=77483) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 22:14:12 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:12 devstack sudo[78319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 22:14:12 devstack sudo[78319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:13 devstack sudo[78319]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:13 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:13 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:13 devstack sudo[78325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 22:14:13 devstack sudo[78325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:13 devstack sudo[78325]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:13 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:13 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:13 devstack sudo[78328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 22:14:13 devstack sudo[78328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:13 devstack sudo[78328]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:13 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:13 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:14:13 devstack sudo[78331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 22:14:13 devstack sudo[78331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:14:13 devstack sudo[78331]: pam_unix(sudo:session): session closed for user root Jul 23 22:14:13 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:14:13 devstack cinder-volume[77483]: INFO cinder.volume.manager [None req-a28d6648-a9bd-4515-b26e-9faf14541ea5 None None] Driver post RPC initialization completed successfully. Jul 23 22:14:16 devstack cinder-volume[77326]: DEBUG dbcounter [-] [77326] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:14:23 devstack cinder-volume[77483]: DEBUG dbcounter [-] [77483] Writing DB stats cinder:SELECT=4 {{(pid=77483) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:14:23 devstack cinder-volume[77483]: DEBUG dbcounter [-] [77483] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77483) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:15:09 devstack cinder-volume[77483]: DEBUG oslo_service.periodic_task [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77483) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:15:09 devstack cinder-volume[77483]: DEBUG cinder.volume.drivers.lvm [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Updating volume stats {{(pid=77483) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 22:15:09 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:15:09 devstack sudo[80308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 22:15:09 devstack sudo[80308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:15:10 devstack sudo[80308]: pam_unix(sudo:session): session closed for user root Jul 23 22:15:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:15:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:15:10 devstack sudo[80311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 22:15:10 devstack sudo[80311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:15:10 devstack sudo[80311]: pam_unix(sudo:session): session closed for user root Jul 23 22:15:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:15:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:15:10 devstack sudo[80314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 22:15:10 devstack sudo[80314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:15:10 devstack sudo[80314]: pam_unix(sudo:session): session closed for user root Jul 23 22:15:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:15:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:15:10 devstack sudo[80349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 22:15:10 devstack sudo[80349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:15:10 devstack sudo[80349]: pam_unix(sudo:session): session closed for user root Jul 23 22:15:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:15:10 devstack cinder-volume[77483]: DEBUG cinder.manager [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Notifying Schedulers of capabilities ... {{(pid=77483) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:15:10 devstack cinder-volume[77483]: DEBUG oslo_service.periodic_task [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running periodic task VolumeManager._thread_info {{(pid=77483) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:15:10 devstack cinder-volume[77483]: DEBUG cinder.volume.manager [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] thread count: 6 {{(pid=77483) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:15:10 devstack cinder-volume[77483]: DEBUG cinder.volume.manager [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] thread info: [<_MainThread(MainThread, started 131202811572352)>, , , , , ] {{(pid=77483) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:16:09 devstack cinder-volume[77483]: DEBUG oslo_service.periodic_task [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77483) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:16:09 devstack cinder-volume[77483]: DEBUG cinder.volume.drivers.lvm [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Updating volume stats {{(pid=77483) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 22:16:09 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:16:09 devstack sudo[83617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 22:16:09 devstack sudo[83617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:16:10 devstack sudo[83617]: pam_unix(sudo:session): session closed for user root Jul 23 22:16:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:16:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:16:10 devstack sudo[83627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 22:16:10 devstack sudo[83627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:16:10 devstack sudo[83627]: pam_unix(sudo:session): session closed for user root Jul 23 22:16:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:16:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:16:10 devstack sudo[83630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 22:16:10 devstack sudo[83630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:16:10 devstack sudo[83630]: pam_unix(sudo:session): session closed for user root Jul 23 22:16:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:16:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:16:10 devstack sudo[83633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 22:16:10 devstack sudo[83633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:16:10 devstack sudo[83633]: pam_unix(sudo:session): session closed for user root Jul 23 22:16:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:16:10 devstack cinder-volume[77483]: DEBUG cinder.manager [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Notifying Schedulers of capabilities ... {{(pid=77483) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:16:10 devstack cinder-volume[77483]: DEBUG oslo_service.periodic_task [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running periodic task VolumeManager._thread_info {{(pid=77483) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:16:10 devstack cinder-volume[77483]: DEBUG cinder.volume.manager [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] thread count: 6 {{(pid=77483) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:16:10 devstack cinder-volume[77483]: DEBUG cinder.volume.manager [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] thread info: [<_MainThread(MainThread, started 131202811572352)>, , , , , ] {{(pid=77483) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:16:23 devstack cinder-volume[77483]: DEBUG dbcounter [-] [77483] Writing DB stats cinder:SELECT=1 {{(pid=77483) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:16:23 devstack cinder-volume[77483]: DEBUG dbcounter [-] [77483] Writing DB stats cinder:UPDATE=1 {{(pid=77483) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:17:09 devstack cinder-volume[77483]: DEBUG oslo_service.periodic_task [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77483) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:17:09 devstack cinder-volume[77483]: DEBUG cinder.volume.drivers.lvm [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Updating volume stats {{(pid=77483) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 22:17:09 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:17:09 devstack sudo[85609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 22:17:09 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:17:10 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root Jul 23 22:17:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:17:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:17:10 devstack sudo[85614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 22:17:10 devstack sudo[85614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:17:10 devstack sudo[85614]: pam_unix(sudo:session): session closed for user root Jul 23 22:17:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:17:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:17:10 devstack sudo[85623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 22:17:10 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:17:10 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root Jul 23 22:17:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:17:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:17:10 devstack sudo[85631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 22:17:10 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:17:10 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root Jul 23 22:17:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:17:10 devstack cinder-volume[77483]: DEBUG cinder.manager [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Notifying Schedulers of capabilities ... {{(pid=77483) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:18:09 devstack cinder-volume[77483]: DEBUG oslo_service.periodic_task [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77483) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:18:09 devstack cinder-volume[77483]: DEBUG cinder.volume.drivers.lvm [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Updating volume stats {{(pid=77483) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 23 22:18:09 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:18:09 devstack sudo[86813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 23 22:18:09 devstack sudo[86813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:18:10 devstack sudo[86813]: pam_unix(sudo:session): session closed for user root Jul 23 22:18:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:18:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:18:10 devstack sudo[86852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 22:18:10 devstack sudo[86852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:18:10 devstack sudo[86852]: pam_unix(sudo:session): session closed for user root Jul 23 22:18:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:18:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:18:10 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 23 22:18:10 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:18:10 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Jul 23 22:18:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:18:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:18:10 devstack sudo[86912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 23 22:18:10 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:18:10 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root Jul 23 22:18:10 devstack cinder-volume[77483]: DEBUG oslo_concurrency.processutils [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=77483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:18:10 devstack cinder-volume[77483]: DEBUG cinder.manager [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Notifying Schedulers of capabilities ... {{(pid=77483) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:18:10 devstack cinder-volume[77483]: DEBUG oslo_service.periodic_task [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] Running periodic task VolumeManager._thread_info {{(pid=77483) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:18:10 devstack cinder-volume[77483]: DEBUG cinder.volume.manager [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] thread count: 6 {{(pid=77483) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:18:10 devstack cinder-volume[77483]: DEBUG cinder.volume.manager [None req-c40aeed8-4a9a-4afe-93ce-271af5bb5794 None None] thread info: [<_MainThread(MainThread, started 131202811572352)>, , , , , ] {{(pid=77483) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:18:23 devstack cinder-volume[77483]: DEBUG dbcounter [-] [77483] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77483) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:18:39 devstack cinder-volume[77326]: INFO oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Caught SIGTERM, stopping children Jul 23 22:18:39 devstack cinder-volume[77326]: DEBUG oslo_concurrency.lockutils [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Acquiring lock "singleton_lock" {{(pid=77326) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 22:18:39 devstack cinder-volume[77326]: DEBUG oslo_concurrency.lockutils [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Acquired lock "singleton_lock" {{(pid=77326) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 22:18:39 devstack cinder-volume[77326]: DEBUG oslo_concurrency.lockutils [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Releasing lock "singleton_lock" {{(pid=77326) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 22:18:39 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Stop services. {{(pid=77326) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 23 22:18:39 devstack cinder-volume[77326]: DEBUG oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Killing children. {{(pid=77326) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 23 22:18:39 devstack cinder-volume[77326]: INFO oslo_service.backend._eventlet.service [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Waiting on 1 children to exit Jul 23 22:18:44 devstack cinder-volume[77483]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 23 22:18:44 devstack cinder-volume[87565]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 23 22:18:44 devstack cinder-volume[87565]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 22:18:44 devstack cinder-volume[87565]: we strongly recommend against using it for new projects. Jul 23 22:18:44 devstack cinder-volume[87565]: If you are already using Eventlet, we recommend migrating to a different Jul 23 22:18:44 devstack cinder-volume[87565]: framework. For more detail see Jul 23 22:18:44 devstack cinder-volume[87565]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 22:18:44 devstack cinder-volume[87565]: import eventlet # noqa Jul 23 22:18:46 devstack cinder-volume[87565]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 22:18:46 devstack cinder-volume[87565]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 22:18:46 devstack cinder-volume[87565]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 22:18:47 devstack cinder-volume[87565]: INFO dbcounter [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Registered counter for database cinder Jul 23 22:18:47 devstack cinder-volume[87565]: DEBUG oslo_db.sqlalchemy.engines [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87565) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 22:18:47 devstack cinder-volume[87565]: DEBUG dbcounter [-] [87565] Writer thread running {{(pid=87565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 22:18:47 devstack cinder-volume[87565]: INFO cinder.rpc [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 23 22:18:47 devstack cinder-volume[87565]: INFO cinder.rpc [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 23 22:18:47 devstack cinder-volume[77483]: DEBUG oslo_concurrency.lockutils [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Acquiring lock "singleton_lock" {{(pid=77483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 22:18:47 devstack cinder-volume[77483]: DEBUG oslo_concurrency.lockutils [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Acquired lock "singleton_lock" {{(pid=77483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 22:18:47 devstack cinder-volume[77483]: DEBUG oslo_concurrency.lockutils [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Releasing lock "singleton_lock" {{(pid=77483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 22:18:47 devstack cinder-volume[77483]: WARNING amqp [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 22:18:47 devstack cinder-volume[77483]: WARNING amqp [None req-c91cee06-b1c8-45ba-a5ff-b34b64b5e41f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 22:18:47 devstack cinder-volume[87565]: DEBUG oslo_db.sqlalchemy.engines [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87565) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 22:18:47 devstack cinder-volume[87565]: INFO cinder.volume.manager [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Determined volume DB was empty at startup. Jul 23 22:18:47 devstack cinder-volume[87565]: DEBUG cinder.volume.manager [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87565) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 23 22:18:47 devstack cinder-volume[87565]: INFO cinder.volume.manager [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 23 22:18:47 devstack cinder-volume[87565]: WARNING stevedore.named [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 22:18:47 devstack cinder-volume[87565]: WARNING castellan.key_manager [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 22:18:47 devstack cinder-volume[87565]: WARNING cinder.keymgr.conf_key_mgr [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 22:18:48 devstack cinder-volume[87565]: INFO cinder.volume.manager [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_db.sqlalchemy.engines [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87565) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 22:18:48 devstack cinder-volume[87565]: INFO oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Starting 1 workers Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Started child 87786 {{(pid=87565) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Full set of CONF: {{(pid=87565) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] ******************************************************************************** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Configuration options gathered from: {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] ================================================================================ {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] allow_availability_zone_fallback = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] allow_compression_on_image_upload = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] allowed_direct_url_schemes = [] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] api_rate_limit = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] auth_strategy = keystone {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_availability_zone = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87786]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_host = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_name = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_stats_polling_interval = 60 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backup_api_class = cinder.backup.api.API {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backup_name_template = backup-%s {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backup_use_same_host = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backup_use_temp_snapshot = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] chap_password = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] chap_username = {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cinder_internal_tenant_project_id = fc5648ee755b4955a30d144ae4198a7a {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cinder_internal_tenant_user_id = a1c3712893644a3eb0b03cc386408ec5 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cluster = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] compression_format = gzip {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] compute_api_class = cinder.compute.nova.API {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] config_dir = [] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] config_source = [] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] control_exchange = openstack {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] debug = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] default_availability_zone = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] default_group_type = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] default_volume_type = QuobyteHD {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] disk_geometry = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] driver_client_cert = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] driver_client_cert_key = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] driver_data_namespace = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] driver_ssl_cert_path = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] driver_ssl_cert_verify = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] driver_use_ssl = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] enable_new_services = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] enable_unsupported_driver = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] enabled_backends = ['QuobyteHD'] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] enforce_multipath_for_image_xfer = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] filter_function = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance_api_insecure = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance_api_servers = ['http://192.168.122.106/image'] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance_api_ssl_compression = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance_ca_certificates_file = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance_catalog_info = image:glance:publicURL {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance_certfile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance_keyfile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance_num_retries = 3 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance_request_timeout = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] goodness_function = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] graceful_shutdown_timeout = 5 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] group_api_class = cinder.group.api.API {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] host = devstack {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] image_compress_on_upload = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] image_conversion_address_space_limit = 1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] image_conversion_cpu_limit = 60 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] image_conversion_disable = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] image_upload_use_cinder_backend = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] image_upload_use_internal_tenant = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] image_volume_cache_enabled = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] image_volume_cache_max_count = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] image_volume_cache_max_size_gb = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] init_host_max_objects_retrieval = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] instance_format = [instance: %(uuid)s] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] iscsi_target_flags = {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] iscsi_write_cache = on {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] iser_helper = tgtadm {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] iser_ip_address = 192.168.122.106 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] iser_port = 3260 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] log_color = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] log_config_append = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] log_dir = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] log_file = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] log_options = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] log_rotate_interval = 1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] log_rotate_interval_type = days {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] log_rotation_type = none {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87786]: INFO cinder.volume.manager [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 23 22:18:48 devstack cinder-volume[87786]: DEBUG cinder.volume.drivers.remotefs [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87786) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] max_age = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] max_logfile_count = 30 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] max_logfile_size_mb = 200 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] max_over_subscription_ratio = 20.0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] message_reap_interval = 86400 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] message_ttl = 2592000 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] migration_create_volume_timeout_secs = 300 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] monkey_patch = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] monkey_patch_modules = [] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] my_ip = 192.168.122.106 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] no_snapshot_gb_quota = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] num_iser_scan_tries = 3 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] num_shell_tries = 3 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] num_volume_device_scan_tries = 3 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] nvmeof_conn_info_version = 1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] nvmet_ns_id = 10 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] nvmet_port_id = 1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] osapi_max_limit = 1000 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] osapi_volume_ext_list = [] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] osapi_volume_listen_port = 8776 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] osapi_volume_use_ssl = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] osapi_volume_workers = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] per_volume_size_limit = -1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] periodic_fuzzy_delay = 60 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] periodic_interval = 60 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] public_endpoint = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] publish_errors = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] quota_backup_gigabytes = 1000 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] quota_backups = 10 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] quota_gigabytes = 1000 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] quota_groups = 10 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] quota_snapshots = 10 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] quota_volumes = 10 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] rate_limit_burst = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] rate_limit_except_level = CRITICAL {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] rate_limit_interval = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] reinit_driver_count = 3 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] replication_device = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] report_discard_supported = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] report_interval = 120 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] reservation_clean_interval = 86400 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] reservation_expire = 86400 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] reserved_image_namespaces = [] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] reserved_percentage = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] rpc_response_timeout = 120 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] run_external_periodic_tasks = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] scst_target_driver = iscsi {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] scst_target_iqn_name = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] service_down_time = 720 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] shell_completion = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] snapshot_name_template = snapshot-%s {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] split_loggers = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] state_path = /opt/stack/data/cinder {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] storage_availability_zone = nova {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] storage_protocol = iSCSI {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] syslog_log_facility = LOG_USER {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] target_helper = lioadm {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] target_ip_address = 192.168.122.106 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] target_port = 3260 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] target_protocol = iscsi {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] target_secondary_ip_addresses = [] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] trace_flags = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] transport_url = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] until_refresh = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] use_chap_auth = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] use_default_quota_class = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] use_journal = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] use_json = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] use_multipath_for_image_xfer = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] use_stderr = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] use_syslog = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] verify_glance_signatures = enabled {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] volume_api_class = cinder.volume.api.API {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] volume_backend_name = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] volume_clear = zero {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] volume_clear_ionice = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] volume_clear_size = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] volume_copy_bps_limit = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] volume_dd_blocksize = 1M {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] volume_name_template = volume-%s {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] volume_service_inithost_offload = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] volume_usage_audit_period = month {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] zoning_mode = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_concurrency.disable_process_locking = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.auth_section = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.auth_type = password {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.auth_version = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.cache = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.certfile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.include_service_catalog = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.insecure = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.interface = public {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.keyfile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcache_password = {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcache_username = {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87786]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87786) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 23 22:18:48 devstack cinder-volume[87786]: WARNING cinder.volume.drivers.quobyte [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 23 22:18:48 devstack cinder-volume[87786]: WARNING cinder.volume.drivers.quobyte [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.region_name = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.service_type = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.106/identity {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.backend = dogpile.cache.null {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.backend_argument = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.backend_expiration_time = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.config_prefix = cache.oslo {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87786]: DEBUG oslo_concurrency.processutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Running cmd (subprocess): mount.quobyte {{(pid=87786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.debug_cache_backend = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.enable_retry_client = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.enable_socket_keepalive = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.enabled = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.expiration_time = 600 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.hashclient_retry_attempts = 2 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.memcache_dead_retry = 300 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.memcache_pool_maxsize = 10 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.memcache_sasl_enabled = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.password = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.proxies = [] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.redis_db = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.redis_server = localhost:6379 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.retry_attempts = 2 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.retry_delay = 0.0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.socket_keepalive_count = 1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.socket_keepalive_idle = 1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.socket_keepalive_interval = 1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.socket_timeout = 1.0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.tls_allowed_ciphers = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.tls_cafile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.tls_certfile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.tls_enabled = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.tls_keyfile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cache.username = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] coordination.backend_url = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.asyncio_connection = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.asyncio_slave_connection = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.backend = sqlalchemy {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.connection = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.connection_debug = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.connection_parameters = {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.connection_recycle_time = 3600 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.connection_trace = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.db_inc_retry_interval = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.db_max_retries = 20 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.db_max_retry_interval = 10 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.db_retry_interval = 1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.max_overflow = 50 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.max_pool_size = 5 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.max_retries = 10 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.mysql_wsrep_sync_wait = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.pool_timeout = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.retry_interval = 10 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.slave_connection = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.sqlite_synchronous = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.synchronous_reader = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] database.use_db_reconnect = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] profiler.connection_string = messaging:// {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] profiler.enabled = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] profiler.es_doc_type = notification {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] profiler.es_scroll_size = 10000 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] profiler.es_scroll_time = 2m {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] profiler.filter_error_trace = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] profiler.hmac_keys = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] profiler.sentinel_service_name = mymaster {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] profiler.socket_timeout = 0.1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] profiler.trace_requests = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] profiler.trace_sqlalchemy = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] profiler_jaeger.process_tags = {} {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] profiler_jaeger.service_name_prefix = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] profiler_otlp.service_name_prefix = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_policy.enforce_new_defaults = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_policy.policy_default_rule = default {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_policy.policy_file = policy.yaml {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] privsep_osbrick.group = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] privsep_osbrick.helper_command = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] privsep_osbrick.user = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cinder_sys_admin.group = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cinder_sys_admin.helper_command = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] cinder_sys_admin.user = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] service_user.auth_section = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] service_user.auth_type = password {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] service_user.cafile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] service_user.certfile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] service_user.collect_timing = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] service_user.insecure = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] service_user.keyfile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] service_user.send_service_user_token = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] service_user.split_loggers = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] service_user.timeout = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance.auth_section = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance.auth_type = password {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance.certfile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance.collect_timing = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance.insecure = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance.keyfile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance.region_name = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance.split_loggers = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] glance.timeout = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.backend_availability_zone = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.chap_password = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87786]: DEBUG oslo_concurrency.processutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] CMD "mount.quobyte" returned: 1 in 0.137s {{(pid=87786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.chap_username = {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.disk_geometry = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.driver_client_cert = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.driver_client_cert_key = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.driver_data_namespace = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.driver_use_ssl = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87786]: DEBUG oslo_concurrency.lockutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87786) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:18:48 devstack cinder-volume[87786]: DEBUG oslo_concurrency.lockutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87786) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:18:48 devstack cinder-volume[87786]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=87786) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:18:48 devstack cinder-volume[87786]: INFO cinder.volume.drivers.quobyte [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 ... Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87786]: DEBUG oslo_concurrency.processutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b -c /etc/quobyte/client-cinder.cfg {{(pid=87786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.extra_capabilities = {} {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.filter_function = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.goodness_function = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.iscsi_target_flags = {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.iscsi_write_cache = on {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.iser_helper = tgtadm {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.iser_ip_address = 192.168.122.106 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.iser_port = 3260 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.nas_host = {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.nas_login = admin {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.nas_mount_options = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.nas_password = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.nas_private_key = {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.nas_share_path = {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.num_shell_tries = 3 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.quobyte_volume_url = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.replication_device = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.report_discard_supported = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.reserved_percentage = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.target_helper = tgtadm {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.target_ip_address = 192.168.122.106 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.target_port = 3260 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.target_protocol = iscsi {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.trace_flags = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.unique_fqdn_network = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.use_chap_auth = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.volume_backend_name = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.volume_clear = zero {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.volume_clear_ionice = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.volume_clear_size = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_reports.file_event_handler = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_reports.log_dir = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.backend_availability_zone = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.backend_host = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.chap_password = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.chap_username = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.chiscsi_conf = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.disk_geometry = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.driver_client_cert = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.driver_data_namespace = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.driver_use_ssl = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.extra_capabilities = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.filter_function = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.goodness_function = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.iser_helper = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.iser_ip_address = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.iser_port = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.iser_target_prefix = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.nas_host = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.nas_login = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.nas_mount_options = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.nas_password = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.nas_private_key = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.nas_share_path = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.nas_ssh_port = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.num_shell_tries = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.nvmet_port_id = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b -c /etc/quobyte/client-cinder.cfg Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.replication_device = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.report_discard_supported = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.reserved_percentage = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.scst_target_driver = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.storage_protocol = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.target_helper = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.target_ip_address = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.target_port = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.target_prefix = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.target_protocol = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.trace_flags = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.use_chap_auth = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.volume_clear = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.volume_clear_size = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] QuobyteHD.volumes_dir = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.ssl = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_notifications.driver = [] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_notifications.retry = -1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] key_manager.fixed_key = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.barbican_api_version = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.barbican_endpoint = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.barbican_endpoint_type = public {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.barbican_region_name = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.cafile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.certfile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.collect_timing = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.insecure = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.keyfile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.number_of_retries = 60 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.retry_delay = 1 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.send_service_user_token = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.split_loggers = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.timeout = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.verify_ssl = True {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican.verify_ssl_path = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican_service_user.auth_section = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican_service_user.auth_type = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican_service_user.cafile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican_service_user.certfile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican_service_user.collect_timing = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican_service_user.insecure = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican_service_user.keyfile = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican_service_user.split_loggers = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] barbican_service_user.timeout = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] vault.approle_role_id = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] vault.approle_secret_id = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] vault.auth_method = approle {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] vault.auth_path = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] vault.kv_mountpoint = secret {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] vault.kv_path = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] vault.kv_version = 2 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] vault.namespace = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] vault.root_token_id = **** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] vault.ssl_ca_crt_file = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] vault.timeout = 60.0 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] vault.token_file = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] vault.token_role = None {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] vault.use_ssl = False {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:48 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] ******************************************************************************** {{(pid=87565) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 23 22:18:49 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG oslo_concurrency.processutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.434s {{(pid=87786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:18:49 devstack cinder-volume[87786]: INFO cinder.volume.drivers.quobyte [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 succeeded Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=87786) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG oslo_concurrency.lockutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.447s {{(pid=87786) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG oslo_concurrency.processutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=87786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:18:49 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:18:49 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:18:49 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG oslo_concurrency.processutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.272s {{(pid=87786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:18:49 devstack cinder-volume[87786]: INFO cinder.volume.driver [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Driver hasn't implemented _init_vendor_properties() Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG cinder.volume.driver [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7198677062988, 'free_capacity_gb': 1775.7198677062988, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87786) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG oslo_db.sqlalchemy.engines [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG dbcounter [-] [87786] Writer thread running {{(pid=87786) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG cinder.db.api [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Building query based on filter {{(pid=87786) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG cinder.image.image_utils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87786) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 23 22:18:49 devstack cinder-volume[87786]: INFO cinder.keymgr.migration [None req-cb128e42-641e-4cab-a937-edb2ac6e2c99 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG oslo_concurrency.lockutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87786) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG oslo_concurrency.lockutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87786) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=87786) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=87786) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG oslo_concurrency.lockutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87786) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG oslo_concurrency.processutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=87786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:18:49 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:18:49 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:18:49 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG oslo_concurrency.processutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.233s {{(pid=87786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG cinder.manager [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Notifying Schedulers of capabilities ... {{(pid=87786) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:18:49 devstack cinder-volume[87786]: INFO cinder.volume.manager [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Driver initialization completed successfully. Jul 23 22:18:49 devstack cinder-volume[87786]: INFO cinder.manager [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Initiating service 3 cleanup Jul 23 22:18:49 devstack cinder-volume[87786]: INFO cinder.manager [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Service 3 cleanup completed. Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG cinder.service [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Creating RPC server for service cinder-volume {{(pid=87786) start /opt/stack/cinder/cinder/service.py:231}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG cinder.service [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87786) start /opt/stack/cinder/cinder/service.py:237}} Jul 23 22:18:49 devstack cinder-volume[87786]: INFO cinder.volume.manager [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG oslo_concurrency.lockutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87786) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG oslo_concurrency.lockutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87786) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=87786) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=87786) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG oslo_concurrency.lockutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87786) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:18:49 devstack cinder-volume[87786]: DEBUG oslo_concurrency.processutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=87786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:18:49 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:18:49 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:18:50 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Jul 23 22:18:50 devstack cinder-volume[87786]: DEBUG oslo_concurrency.processutils [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.297s {{(pid=87786) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:18:50 devstack cinder-volume[87786]: INFO cinder.volume.manager [None req-cbfa01b9-5519-4bee-a1fd-d43688ea97f8 None None] Driver post RPC initialization completed successfully. Jul 23 22:18:53 devstack cinder-volume[87565]: INFO oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Caught SIGTERM, stopping children Jul 23 22:18:53 devstack cinder-volume[87565]: DEBUG oslo_concurrency.lockutils [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Acquiring lock "singleton_lock" {{(pid=87565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 22:18:53 devstack cinder-volume[87565]: DEBUG oslo_concurrency.lockutils [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Acquired lock "singleton_lock" {{(pid=87565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 22:18:53 devstack cinder-volume[87565]: DEBUG oslo_concurrency.lockutils [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Releasing lock "singleton_lock" {{(pid=87565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 22:18:53 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Stop services. {{(pid=87565) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 23 22:18:53 devstack cinder-volume[87565]: DEBUG oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Killing children. {{(pid=87565) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 23 22:18:53 devstack cinder-volume[87565]: INFO oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Waiting on 1 children to exit Jul 23 22:18:53 devstack cinder-volume[87786]: DEBUG oslo_concurrency.lockutils [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Acquiring lock "singleton_lock" {{(pid=87786) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 22:18:53 devstack cinder-volume[87786]: DEBUG oslo_concurrency.lockutils [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Acquired lock "singleton_lock" {{(pid=87786) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 22:18:53 devstack cinder-volume[87786]: DEBUG oslo_concurrency.lockutils [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Releasing lock "singleton_lock" {{(pid=87786) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 22:18:53 devstack cinder-volume[87786]: WARNING amqp [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 22:18:54 devstack cinder-volume[87786]: WARNING amqp [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 23 22:18:54 devstack cinder-volume[87565]: INFO oslo_service.backend._eventlet.service [None req-8632ca8a-059b-4cab-bc73-104088a73ae5 None None] Child 87786 exited with status 0 Jul 23 22:18:54 devstack cinder-volume[88057]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 23 22:18:54 devstack cinder-volume[88057]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 22:18:54 devstack cinder-volume[88057]: we strongly recommend against using it for new projects. Jul 23 22:18:54 devstack cinder-volume[88057]: If you are already using Eventlet, we recommend migrating to a different Jul 23 22:18:54 devstack cinder-volume[88057]: framework. For more detail see Jul 23 22:18:54 devstack cinder-volume[88057]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 22:18:54 devstack cinder-volume[88057]: import eventlet # noqa Jul 23 22:18:57 devstack cinder-volume[88057]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88057) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 23 22:18:57 devstack cinder-volume[88057]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88057) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 23 22:18:57 devstack cinder-volume[88057]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88057) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 23 22:18:58 devstack cinder-volume[88057]: INFO dbcounter [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] Registered counter for database cinder Jul 23 22:18:58 devstack cinder-volume[88057]: DEBUG oslo_db.sqlalchemy.engines [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88057) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG dbcounter [-] [88057] Writer thread running {{(pid=88057) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 22:18:59 devstack cinder-volume[88057]: INFO cinder.rpc [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 23 22:18:59 devstack cinder-volume[88057]: INFO cinder.rpc [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_db.sqlalchemy.engines [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88057) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 22:18:59 devstack cinder-volume[88057]: INFO cinder.volume.manager [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] Determined volume DB was empty at startup. Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG cinder.volume.manager [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88057) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 23 22:18:59 devstack cinder-volume[88057]: WARNING stevedore.named [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 23 22:18:59 devstack cinder-volume[88057]: WARNING castellan.key_manager [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 22:18:59 devstack cinder-volume[88057]: WARNING cinder.keymgr.conf_key_mgr [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 23 22:18:59 devstack cinder-volume[88057]: INFO cinder.volume.manager [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_db.sqlalchemy.engines [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88057) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 22:18:59 devstack cinder-volume[88057]: INFO oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] Starting 1 workers Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] Started child 88308 {{(pid=88057) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] Full set of CONF: {{(pid=88057) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] ******************************************************************************** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] Configuration options gathered from: {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 23 22:18:59 devstack cinder-volume[88308]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] ================================================================================ {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] allow_availability_zone_fallback = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] allow_compression_on_image_upload = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] allowed_direct_url_schemes = [] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] api_rate_limit = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] auth_strategy = keystone {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_availability_zone = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_host = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_name = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_stats_polling_interval = 60 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backup_api_class = cinder.backup.api.API {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backup_name_template = backup-%s {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backup_use_same_host = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backup_use_temp_snapshot = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] chap_password = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] chap_username = {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cinder_internal_tenant_project_id = fc5648ee755b4955a30d144ae4198a7a {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cinder_internal_tenant_user_id = a1c3712893644a3eb0b03cc386408ec5 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cluster = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] compression_format = gzip {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] compute_api_class = cinder.compute.nova.API {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] config_dir = [] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] config_source = [] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] control_exchange = openstack {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] debug = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] default_availability_zone = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] default_group_type = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] default_volume_type = QuobyteHD {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] disk_geometry = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] driver_client_cert = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] driver_client_cert_key = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] driver_data_namespace = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] driver_ssl_cert_path = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] driver_ssl_cert_verify = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] driver_use_ssl = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] enable_new_services = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] enable_unsupported_driver = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] enabled_backends = ['QuobyteHD'] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] enforce_multipath_for_image_xfer = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] filter_function = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance_api_insecure = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance_api_servers = ['http://192.168.122.106/image'] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance_api_ssl_compression = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance_ca_certificates_file = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance_catalog_info = image:glance:publicURL {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance_certfile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance_keyfile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance_num_retries = 3 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance_request_timeout = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] goodness_function = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] graceful_shutdown_timeout = 5 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] group_api_class = cinder.group.api.API {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] host = devstack {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] image_compress_on_upload = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] image_conversion_address_space_limit = 1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] image_conversion_cpu_limit = 60 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] image_conversion_disable = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] image_upload_use_cinder_backend = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] image_upload_use_internal_tenant = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] image_volume_cache_enabled = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] image_volume_cache_max_count = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] image_volume_cache_max_size_gb = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] init_host_max_objects_retrieval = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] instance_format = [instance: %(uuid)s] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] iscsi_target_flags = {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] iscsi_write_cache = on {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] iser_helper = tgtadm {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] iser_ip_address = 192.168.122.106 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] iser_port = 3260 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] log_color = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] log_config_append = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] log_dir = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] log_file = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] log_options = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] log_rotate_interval = 1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] log_rotate_interval_type = days {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] log_rotation_type = none {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] max_age = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] max_logfile_count = 30 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] max_logfile_size_mb = 200 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] max_over_subscription_ratio = 20.0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] message_reap_interval = 86400 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] message_ttl = 2592000 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] migration_create_volume_timeout_secs = 300 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] monkey_patch = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] monkey_patch_modules = [] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] my_ip = 192.168.122.106 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] no_snapshot_gb_quota = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] num_iser_scan_tries = 3 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] num_shell_tries = 3 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] num_volume_device_scan_tries = 3 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] nvmeof_conn_info_version = 1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] nvmet_ns_id = 10 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] nvmet_port_id = 1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] osapi_max_limit = 1000 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] osapi_volume_ext_list = [] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Starting volume driver QuobyteDriver (1.1.14) Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] osapi_volume_listen_port = 8776 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] osapi_volume_use_ssl = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] osapi_volume_workers = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88308) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] per_volume_size_limit = -1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] periodic_fuzzy_delay = 60 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] periodic_interval = 60 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] public_endpoint = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] publish_errors = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] quota_backup_gigabytes = 1000 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] quota_backups = 10 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] quota_gigabytes = 1000 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] quota_groups = 10 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] quota_snapshots = 10 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] quota_volumes = 10 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] rate_limit_burst = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] rate_limit_except_level = CRITICAL {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] rate_limit_interval = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] reinit_driver_count = 3 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] replication_device = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] report_discard_supported = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] report_interval = 120 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] reservation_clean_interval = 86400 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] reservation_expire = 86400 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] reserved_image_namespaces = [] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] reserved_percentage = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] rpc_response_timeout = 120 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] run_external_periodic_tasks = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] scst_target_driver = iscsi {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] scst_target_iqn_name = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] service_down_time = 720 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] shell_completion = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] snapshot_name_template = snapshot-%s {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] split_loggers = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] state_path = /opt/stack/data/cinder {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] storage_availability_zone = nova {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] storage_protocol = iSCSI {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] syslog_log_facility = LOG_USER {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] target_helper = lioadm {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] target_ip_address = 192.168.122.106 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] target_port = 3260 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] target_protocol = iscsi {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] target_secondary_ip_addresses = [] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] trace_flags = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] transport_url = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] until_refresh = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] use_chap_auth = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] use_default_quota_class = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] use_journal = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] use_json = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] use_multipath_for_image_xfer = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] use_stderr = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] use_syslog = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] verify_glance_signatures = enabled {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] volume_api_class = cinder.volume.api.API {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] volume_backend_name = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] volume_clear = zero {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] volume_clear_ionice = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] volume_clear_size = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] volume_copy_bps_limit = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] volume_dd_blocksize = 1M {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] volume_name_template = volume-%s {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] volume_service_inithost_offload = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] volume_usage_audit_period = month {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] zoning_mode = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_concurrency.disable_process_locking = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.auth_section = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.auth_type = password {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.auth_version = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.cache = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.certfile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.include_service_catalog = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.insecure = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.interface = public {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.keyfile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcache_password = {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcache_username = {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.region_name = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.service_type = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.106/identity {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.backend = dogpile.cache.null {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.backend_argument = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.backend_expiration_time = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.config_prefix = cache.oslo {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.debug_cache_backend = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.enable_retry_client = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.enable_socket_keepalive = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.enabled = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.expiration_time = 600 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.hashclient_retry_attempts = 2 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.memcache_dead_retry = 300 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.memcache_pool_maxsize = 10 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.memcache_sasl_enabled = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.password = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.proxies = [] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.redis_db = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.redis_server = localhost:6379 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.retry_attempts = 2 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.retry_delay = 0.0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.socket_keepalive_count = 1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.socket_keepalive_idle = 1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.socket_keepalive_interval = 1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.socket_timeout = 1.0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.tls_allowed_ciphers = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.tls_cafile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.tls_certfile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.tls_enabled = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.tls_keyfile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cache.username = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] coordination.backend_url = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.asyncio_connection = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.asyncio_slave_connection = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.backend = sqlalchemy {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.connection = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.connection_debug = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.connection_parameters = {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.connection_recycle_time = 3600 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.connection_trace = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.db_inc_retry_interval = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.db_max_retries = 20 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.db_max_retry_interval = 10 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.db_retry_interval = 1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.max_overflow = 50 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.max_pool_size = 5 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.max_retries = 10 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.mysql_wsrep_sync_wait = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.pool_timeout = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.retry_interval = 10 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.slave_connection = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.sqlite_synchronous = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.synchronous_reader = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] database.use_db_reconnect = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] profiler.connection_string = messaging:// {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] profiler.enabled = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] profiler.es_doc_type = notification {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] profiler.es_scroll_size = 10000 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] profiler.es_scroll_time = 2m {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] profiler.filter_error_trace = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] profiler.hmac_keys = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] profiler.sentinel_service_name = mymaster {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] profiler.socket_timeout = 0.1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] profiler.trace_requests = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] profiler.trace_sqlalchemy = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] profiler_jaeger.process_tags = {} {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] profiler_jaeger.service_name_prefix = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] profiler_otlp.service_name_prefix = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_policy.enforce_new_defaults = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_policy.policy_default_rule = default {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_policy.policy_file = policy.yaml {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88308) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 23 22:18:59 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.quobyte [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 23 22:18:59 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.quobyte [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] privsep_osbrick.group = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] privsep_osbrick.helper_command = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Running cmd (subprocess): mount.quobyte {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] privsep_osbrick.user = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cinder_sys_admin.group = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cinder_sys_admin.helper_command = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] cinder_sys_admin.user = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] service_user.auth_section = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] service_user.auth_type = password {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] service_user.cafile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] service_user.certfile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] service_user.collect_timing = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] service_user.insecure = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] service_user.keyfile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] service_user.send_service_user_token = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] service_user.split_loggers = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] service_user.timeout = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance.auth_section = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance.auth_type = password {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance.certfile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance.collect_timing = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance.insecure = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance.keyfile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance.region_name = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance.split_loggers = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] glance.timeout = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.backend_availability_zone = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.chap_password = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.chap_username = {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.disk_geometry = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.driver_client_cert = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.driver_client_cert_key = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.driver_data_namespace = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.driver_use_ssl = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.extra_capabilities = {} {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.filter_function = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.goodness_function = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.iscsi_target_flags = {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.iscsi_write_cache = on {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.iser_helper = tgtadm {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.iser_ip_address = 192.168.122.106 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.iser_port = 3260 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.nas_host = {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.nas_login = admin {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.nas_mount_options = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.nas_password = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.nas_private_key = {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.nas_share_path = {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.num_shell_tries = 3 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.quobyte_volume_url = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.replication_device = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.report_discard_supported = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.reserved_percentage = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.target_helper = tgtadm {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.target_ip_address = 192.168.122.106 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.target_port = 3260 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.target_protocol = iscsi {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.trace_flags = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.unique_fqdn_network = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.use_chap_auth = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.volume_backend_name = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.volume_clear = zero {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.volume_clear_ionice = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.volume_clear_size = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_reports.file_event_handler = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_reports.log_dir = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.backend_availability_zone = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.backend_host = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.chap_password = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.chap_username = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.chiscsi_conf = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.disk_geometry = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.driver_client_cert = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.driver_data_namespace = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.driver_use_ssl = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.extra_capabilities = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.filter_function = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.goodness_function = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.iser_helper = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.iser_ip_address = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.iser_port = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.iser_target_prefix = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.nas_host = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.nas_login = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.nas_mount_options = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.nas_password = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.nas_private_key = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.nas_share_path = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.nas_ssh_port = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.num_shell_tries = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.nvmet_port_id = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.replication_device = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.report_discard_supported = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.reserved_percentage = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.scst_target_driver = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.storage_protocol = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.target_helper = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.target_ip_address = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.target_port = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.target_prefix = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.target_protocol = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.trace_flags = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.use_chap_auth = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.volume_clear = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.volume_clear_size = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] QuobyteHD.volumes_dir = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.ssl = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_notifications.driver = [] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_notifications.retry = -1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] key_manager.fixed_key = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.barbican_api_version = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.barbican_endpoint = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.barbican_endpoint_type = public {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.barbican_region_name = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.cafile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.certfile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.collect_timing = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.insecure = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.keyfile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.number_of_retries = 60 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.retry_delay = 1 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.send_service_user_token = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.split_loggers = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.timeout = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.verify_ssl = True {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican.verify_ssl_path = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican_service_user.auth_section = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican_service_user.auth_type = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican_service_user.cafile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican_service_user.certfile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican_service_user.collect_timing = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican_service_user.insecure = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican_service_user.keyfile = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican_service_user.split_loggers = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] barbican_service_user.timeout = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] vault.approle_role_id = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] vault.approle_secret_id = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] vault.auth_method = approle {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] vault.auth_path = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] vault.kv_mountpoint = secret {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] vault.kv_path = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] vault.kv_version = 2 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] vault.namespace = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] vault.root_token_id = **** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] vault.ssl_ca_crt_file = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] vault.timeout = 60.0 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] vault.token_file = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] vault.token_role = None {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] vault.use_ssl = False {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 23 22:18:59 devstack cinder-volume[88057]: DEBUG oslo_service.backend._eventlet.service [None req-b0df3bab-67c4-40c1-b4d7-24a0a70b0d91 None None] ******************************************************************************** {{(pid=88057) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 23 22:18:59 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Jul 23 22:18:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.316s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:18:59 devstack cinder-volume[88308]: INFO cinder.volume.driver [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Driver hasn't implemented _init_vendor_properties() Jul 23 22:18:59 devstack cinder-volume[88308]: DEBUG cinder.volume.driver [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7198677062988, 'free_capacity_gb': 1775.7198677062988, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88308) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG oslo_db.sqlalchemy.engines [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88308) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writer thread running {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG cinder.db.api [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Building query based on filter {{(pid=88308) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88308) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:19:00 devstack cinder-volume[88308]: INFO cinder.keymgr.migration [None req-ae9038dc-c35f-491d-b66c-99f7f28b740e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 23 22:19:00 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:19:00 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:19:00 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.317s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:19:00 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Driver initialization completed successfully. Jul 23 22:19:00 devstack cinder-volume[88308]: INFO cinder.manager [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Initiating service 3 cleanup Jul 23 22:19:00 devstack cinder-volume[88308]: INFO cinder.manager [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Service 3 cleanup completed. Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG cinder.service [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Creating RPC server for service cinder-volume {{(pid=88308) start /opt/stack/cinder/cinder/service.py:231}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG cinder.service [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88308) start /opt/stack/cinder/cinder/service.py:237}} Jul 23 22:19:00 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:19:00 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:19:00 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:19:00 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Jul 23 22:19:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.365s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:19:00 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e8ffff54-1367-4a9e-962b-cf12972f9d9e None None] Driver post RPC initialization completed successfully. Jul 23 22:19:09 devstack cinder-volume[88057]: DEBUG dbcounter [-] [88057] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88057) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:19:10 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=3 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:19:10 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:19:25 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:19:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 6 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:19:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:19:59 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:19:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Flow 'volume_create_manager' (88c782f5-cede-4deb-b1b9-6743cf076d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:19:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (454c7faa-854f-46a7-ba19-31f87778d20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (454c7faa-854f-46a7-ba19-31f87778d20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-277867045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53bc3402-61cd-48a7-bab3-0076f33cf7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a20a57ed0b47ea9b251bc436a2cac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:20:00Z,use_quota=True,user_id='9835593b007d45628487b9ccdade13d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044c3b00-8434-4258-84b2-62fdb56ceff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044c3b00-8434-4258-84b2-62fdb56ceff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f865ab6e-715a-4be7-825e-392323a8c050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f865ab6e-715a-4be7-825e-392323a8c050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53bc3402-61cd-48a7-bab3-0076f33cf7bb', 'volume_name': 'volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30510529-6aa1-4185-af8e-3fa472c4eae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30510529-6aa1-4185-af8e-3fa472c4eae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68a8191-cc22-48e9-99f6-d106d666b083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:00 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Volume 53bc3402-61cd-48a7-bab3-0076f33cf7bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb', 'volume_size': 1} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-277867045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53bc3402-61cd-48a7-bab3-0076f33cf7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a20a57ed0b47ea9b251bc436a2cac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:20:00Z,use_quota=True,user_id='9835593b007d45628487b9ccdade13d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Creating volume 53bc3402-61cd-48a7-bab3-0076f33cf7bb {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:20:00 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:20:00 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb 1073741824 Jul 23 22:20:00 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:20:00 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb 1073741824" returned: 0 in 0.599s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:20:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:20:00 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb Jul 23 22:20:00 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:20:01 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Jul 23 22:20:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb" returned: 0 in 0.341s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:20:01 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:20:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:20:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68a8191-cc22-48e9-99f6-d106d666b083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d576a75b-6fef-4444-a7cb-b2afc9797e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:01 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Volume volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb (53bc3402-61cd-48a7-bab3-0076f33cf7bb): created successfully Jul 23 22:20:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d576a75b-6fef-4444-a7cb-b2afc9797e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Flow 'volume_create_manager' (88c782f5-cede-4deb-b1b9-6743cf076d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:20:01 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-83fda960-81e4-438b-befb-88b4c04cde0c tempest-TaggedAttachmentsTest-509122766 None] Created volume successfully. Jul 23 22:20:11 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:20:11 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:20:25 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:20:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:20:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:20:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:20:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:20:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:20:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:20:26 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:20:26 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:20:26 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Jul 23 22:20:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.698s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:20:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:20:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:20:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 6 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:20:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Flow 'volume_create_manager' (325e89f5-4539-4e48-9d1e-1344536f187d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5741a94-3e14-4334-82a3-c970bbc4149d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5741a94-3e14-4334-82a3-c970bbc4149d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-969831737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba912f1-781b-4c11-adfe-d64b6429d281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27b8ed37ce24fc4b39e9ad91cdde41f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:20:28Z,use_quota=True,user_id='134d4b2ddf484bf8ae88ad583fd37a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e4a5a0-a2cb-4ca2-b743-eb6b83f93006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e4a5a0-a2cb-4ca2-b743-eb6b83f93006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86dc92e6-7025-4407-8d9e-14056a734f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86dc92e6-7025-4407-8d9e-14056a734f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cba912f1-781b-4c11-adfe-d64b6429d281', 'volume_name': 'volume-cba912f1-781b-4c11-adfe-d64b6429d281', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebb6054-16ca-4d1e-b700-0c81739bbc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebb6054-16ca-4d1e-b700-0c81739bbc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f29676-b68b-4607-94ab-6ca45563540d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:27 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Volume cba912f1-781b-4c11-adfe-d64b6429d281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cba912f1-781b-4c11-adfe-d64b6429d281', 'volume_size': 1} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-969831737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba912f1-781b-4c11-adfe-d64b6429d281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e27b8ed37ce24fc4b39e9ad91cdde41f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:20:28Z,use_quota=True,user_id='134d4b2ddf484bf8ae88ad583fd37a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Creating volume cba912f1-781b-4c11-adfe-d64b6429d281 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:20:27 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:20:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cba912f1-781b-4c11-adfe-d64b6429d281 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:20:28 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cba912f1-781b-4c11-adfe-d64b6429d281 1073741824 Jul 23 22:20:28 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:20:28 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Jul 23 22:20:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cba912f1-781b-4c11-adfe-d64b6429d281 1073741824" returned: 0 in 0.898s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:20:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cba912f1-781b-4c11-adfe-d64b6429d281 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:20:28 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cba912f1-781b-4c11-adfe-d64b6429d281 Jul 23 22:20:28 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:20:29 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Jul 23 22:20:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cba912f1-781b-4c11-adfe-d64b6429d281" returned: 0 in 0.796s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:20:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:20:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:20:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f29676-b68b-4607-94ab-6ca45563540d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cba912f1-781b-4c11-adfe-d64b6429d281', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe729108-1bf8-43cd-8e93-5fc0f29a6d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:29 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Volume volume-cba912f1-781b-4c11-adfe-d64b6429d281 (cba912f1-781b-4c11-adfe-d64b6429d281): created successfully Jul 23 22:20:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe729108-1bf8-43cd-8e93-5fc0f29a6d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Flow 'volume_create_manager' (325e89f5-4539-4e48-9d1e-1344536f187d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:20:29 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b95e87d6-e7b6-48ba-bcc1-c512eae5b3f6 tempest-VolumesAdminNegativeTest-2013781321 None] Created volume successfully. Jul 23 22:20:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Acquiring lock "cinder-cba912f1-781b-4c11-adfe-d64b6429d281-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:20:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Lock "cinder-cba912f1-781b-4c11-adfe-d64b6429d281-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:20:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Acquiring lock "cinder-quobyte-cba912f1-781b-4c11-adfe-d64b6429d281" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:20:32 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Lock "cinder-quobyte-cba912f1-781b-4c11-adfe-d64b6429d281" acquired by "delete_volume" :: waited 0.065s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:20:32 devstack cinder-volume[88308]: INFO oslo.privsep.daemon [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpt2rkal0d/privsep.sock'] Jul 23 22:20:32 devstack sudo[89567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpt2rkal0d/privsep.sock Jul 23 22:20:32 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:20:34 devstack cinder-volume[88308]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 23 22:20:34 devstack cinder-volume[88308]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 23 22:20:34 devstack cinder-volume[88308]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 23 22:20:34 devstack cinder-volume[88308]: WARNING oslo.privsep.daemon [-] privsep log: Jul 23 22:20:34 devstack cinder-volume[88308]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 23 22:20:34 devstack cinder-volume[88308]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 23 22:20:34 devstack cinder-volume[88308]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 23 22:20:34 devstack cinder-volume[88308]: WARNING oslo.privsep.daemon [-] privsep log: Jul 23 22:20:34 devstack cinder-volume[88308]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 23 22:20:35 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root Jul 23 22:20:35 devstack cinder-volume[88308]: INFO oslo.privsep.daemon [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Spawned new privsep daemon via rootwrap Jul 23 22:20:35 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Accepted privsep connection to /tmp/tmpt2rkal0d/privsep.sock {{(pid=88308) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 23 22:20:35 devstack cinder-volume[88308]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 23 22:20:35 devstack cinder-volume[88308]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 23 22:20:35 devstack cinder-volume[88308]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 23 22:20:35 devstack cinder-volume[88308]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89661 Jul 23 22:20:35 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c8f4af-b5e7-4a48-b8bc-eaa29009611e]: (2,) {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:20:35 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e33b02-7df6-471e-a3d3-b8c46602e5e3]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:20:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cba912f1-781b-4c11-adfe-d64b6429d281 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:20:35 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cba912f1-781b-4c11-adfe-d64b6429d281 Jul 23 22:20:35 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:20:36 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Jul 23 22:20:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cba912f1-781b-4c11-adfe-d64b6429d281" returned: 0 in 0.975s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:20:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cba912f1-781b-4c11-adfe-d64b6429d281 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:20:36 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cba912f1-781b-4c11-adfe-d64b6429d281 Jul 23 22:20:36 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:20:37 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Jul 23 22:20:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cba912f1-781b-4c11-adfe-d64b6429d281" returned: 0 in 0.408s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:20:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Lock "cinder-quobyte-cba912f1-781b-4c11-adfe-d64b6429d281" released by "delete_volume" :: held 5.061s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:20:37 devstack cinder-volume[88308]: WARNING cinder.quota [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:20:37 devstack cinder-volume[88308]: WARNING cinder.quota [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:20:37 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Created reservations ['73784a99-e756-4cc8-9c97-38dc77650e31', 'bf68b6cc-6b08-421c-85fe-d4a9c0c3065c', 'a936485c-5b46-46d6-b528-e593233b36d9', '612292e5-7ebf-479f-9e38-4f1c4a7b101e'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:20:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:20:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:20:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:20:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:20:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:20:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:20:38 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:20:38 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:20:38 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Jul 23 22:20:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.517s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:20:38 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:20:38 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Deleted volume successfully. Jul 23 22:20:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4712982c-2da4-4dce-9f97-a3ca1604d03c tempest-VolumesAdminNegativeTest-2013781321 None] Lock "cinder-cba912f1-781b-4c11-adfe-d64b6429d281-delete_volume" released by "delete_volume" :: held 6.584s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:20:47 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=6,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Flow 'volume_create_manager' (e98df1d3-a620-4d18-bbef-19e30a1cad40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e88284-62aa-4b34-8842-3e9ef5f31b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e88284-62aa-4b34-8842-3e9ef5f31b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1400810852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81e6141-8369-40a6-824a-538b0af40674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d3239e086948a7a730d05b6616ff0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:20:48Z,use_quota=True,user_id='3ab260bf9b4a481d81c57845fbc876c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9306504d-5681-4c2f-a042-58c9a51484fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9306504d-5681-4c2f-a042-58c9a51484fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ba83ed-b185-41b9-b4e2-bccf52a39205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ba83ed-b185-41b9-b4e2-bccf52a39205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd81e6141-8369-40a6-824a-538b0af40674', 'volume_name': 'volume-d81e6141-8369-40a6-824a-538b0af40674', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156d41c6-c00b-4e9a-8c3d-0dfaed8642e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156d41c6-c00b-4e9a-8c3d-0dfaed8642e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756474fb-fab3-49f5-b8af-625ccbf5276d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:48 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Volume d81e6141-8369-40a6-824a-538b0af40674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d81e6141-8369-40a6-824a-538b0af40674', 'volume_size': 1} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1400810852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81e6141-8369-40a6-824a-538b0af40674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d3239e086948a7a730d05b6616ff0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:20:48Z,use_quota=True,user_id='3ab260bf9b4a481d81c57845fbc876c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Creating volume d81e6141-8369-40a6-824a-538b0af40674 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:20:48 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:20:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d81e6141-8369-40a6-824a-538b0af40674 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:20:48 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d81e6141-8369-40a6-824a-538b0af40674 1073741824 Jul 23 22:20:48 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:20:49 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Jul 23 22:20:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d81e6141-8369-40a6-824a-538b0af40674 1073741824" returned: 0 in 0.666s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:20:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d81e6141-8369-40a6-824a-538b0af40674 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:20:49 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d81e6141-8369-40a6-824a-538b0af40674 Jul 23 22:20:49 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:20:49 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Jul 23 22:20:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d81e6141-8369-40a6-824a-538b0af40674" returned: 0 in 0.281s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:20:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:20:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:20:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756474fb-fab3-49f5-b8af-625ccbf5276d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d81e6141-8369-40a6-824a-538b0af40674', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b10684-c042-45c0-b758-1b1b48efe9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:49 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Volume volume-d81e6141-8369-40a6-824a-538b0af40674 (d81e6141-8369-40a6-824a-538b0af40674): created successfully Jul 23 22:20:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b10684-c042-45c0-b758-1b1b48efe9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Flow 'volume_create_manager' (e98df1d3-a620-4d18-bbef-19e30a1cad40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:20:49 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ccb65722-dadb-442f-ae64-bd14840291e5 tempest-ServersNegativeTestJSON-204443294 None] Created volume successfully. Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Flow 'volume_create_manager' (80d1418b-46c0-4907-acb7-4b95b0debefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f158a6-2330-406d-8c85-09ee9b7ee4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f158a6-2330-406d-8c85-09ee9b7ee4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1937249505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865ec80e-31f2-4b9d-add5-d83e011fd4bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d3239e086948a7a730d05b6616ff0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:20:55Z,use_quota=True,user_id='3ab260bf9b4a481d81c57845fbc876c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e46563e-e9c7-463d-8594-af82dfc08b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e46563e-e9c7-463d-8594-af82dfc08b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcbef954-0dec-4190-a473-dd532fca7cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcbef954-0dec-4190-a473-dd532fca7cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '865ec80e-31f2-4b9d-add5-d83e011fd4bd', 'volume_name': 'volume-865ec80e-31f2-4b9d-add5-d83e011fd4bd', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe99e8e1-1c13-48b9-a09a-ec2217c6194f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe99e8e1-1c13-48b9-a09a-ec2217c6194f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b69991-7310-4b6d-8bfc-bb0488f8f1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:55 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Volume 865ec80e-31f2-4b9d-add5-d83e011fd4bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-865ec80e-31f2-4b9d-add5-d83e011fd4bd', 'volume_size': 1} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1937249505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865ec80e-31f2-4b9d-add5-d83e011fd4bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25d3239e086948a7a730d05b6616ff0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:20:55Z,use_quota=True,user_id='3ab260bf9b4a481d81c57845fbc876c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Creating volume 865ec80e-31f2-4b9d-add5-d83e011fd4bd {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:20:55 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:20:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-865ec80e-31f2-4b9d-add5-d83e011fd4bd 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:20:55 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-865ec80e-31f2-4b9d-add5-d83e011fd4bd 1073741824 Jul 23 22:20:55 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:20:56 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Jul 23 22:20:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-865ec80e-31f2-4b9d-add5-d83e011fd4bd 1073741824" returned: 0 in 0.597s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:20:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-865ec80e-31f2-4b9d-add5-d83e011fd4bd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:20:56 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-865ec80e-31f2-4b9d-add5-d83e011fd4bd Jul 23 22:20:56 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:20:56 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Jul 23 22:20:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-865ec80e-31f2-4b9d-add5-d83e011fd4bd" returned: 0 in 0.320s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:20:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:20:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:20:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b69991-7310-4b6d-8bfc-bb0488f8f1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865ec80e-31f2-4b9d-add5-d83e011fd4bd', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fce6411-22fe-4147-ae36-c316252f4622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:20:56 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Volume volume-865ec80e-31f2-4b9d-add5-d83e011fd4bd (865ec80e-31f2-4b9d-add5-d83e011fd4bd): created successfully Jul 23 22:20:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fce6411-22fe-4147-ae36-c316252f4622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:20:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Flow 'volume_create_manager' (80d1418b-46c0-4907-acb7-4b95b0debefd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:20:56 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-218ff0df-c8f8-408b-af87-02190b11b398 tempest-ServersNegativeTestJSON-204443294 None] Created volume successfully. Jul 23 22:20:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Acquiring lock "cinder-865ec80e-31f2-4b9d-add5-d83e011fd4bd-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:20:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Lock "cinder-865ec80e-31f2-4b9d-add5-d83e011fd4bd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:21:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Acquiring lock "cinder-quobyte-865ec80e-31f2-4b9d-add5-d83e011fd4bd" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:21:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Lock "cinder-quobyte-865ec80e-31f2-4b9d-add5-d83e011fd4bd" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:21:00 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0c5d5a-5b31-4544-a3e8-1918e6520d80]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:21:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-865ec80e-31f2-4b9d-add5-d83e011fd4bd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:00 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-865ec80e-31f2-4b9d-add5-d83e011fd4bd Jul 23 22:21:00 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:00 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-865ec80e-31f2-4b9d-add5-d83e011fd4bd" returned: 0 in 0.519s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-865ec80e-31f2-4b9d-add5-d83e011fd4bd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:00 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-865ec80e-31f2-4b9d-add5-d83e011fd4bd Jul 23 22:21:00 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:01 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-865ec80e-31f2-4b9d-add5-d83e011fd4bd" returned: 0 in 0.431s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:01 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Lock "cinder-quobyte-865ec80e-31f2-4b9d-add5-d83e011fd4bd" released by "delete_volume" :: held 1.034s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:21:01 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Created reservations ['31bd3670-ca49-46aa-8a0a-fc81a727656a', '672f8346-b8ea-4f3d-9d50-703f794e6a0a', 'fd4856bc-131d-40cb-b882-526fe331a275', 'b2c4b173-8713-4e1c-b3ef-d91685d94da2'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:21:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:21:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:21:01 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:21:01 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:21:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:21:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:01 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:21:01 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:01 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.383s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:01 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:21:01 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Deleted volume successfully. Jul 23 22:21:01 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ae727ae-219b-432c-aa99-526f0872b659 tempest-ServersNegativeTestJSON-204443294 None] Lock "cinder-865ec80e-31f2-4b9d-add5-d83e011fd4bd-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:21:02 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Acquiring lock "cinder-d81e6141-8369-40a6-824a-538b0af40674-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:21:02 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Lock "cinder-d81e6141-8369-40a6-824a-538b0af40674-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:21:02 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Acquiring lock "cinder-quobyte-d81e6141-8369-40a6-824a-538b0af40674" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:21:02 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Lock "cinder-quobyte-d81e6141-8369-40a6-824a-538b0af40674" acquired by "delete_volume" :: waited 0.031s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:21:02 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa9f341-60ab-4f2d-a2e4-92fffba06702]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:21:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d81e6141-8369-40a6-824a-538b0af40674 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:02 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d81e6141-8369-40a6-824a-538b0af40674 Jul 23 22:21:02 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:02 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d81e6141-8369-40a6-824a-538b0af40674" returned: 0 in 0.533s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d81e6141-8369-40a6-824a-538b0af40674 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:02 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d81e6141-8369-40a6-824a-538b0af40674 Jul 23 22:21:02 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:03 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d81e6141-8369-40a6-824a-538b0af40674" returned: 0 in 0.384s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:03 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Lock "cinder-quobyte-d81e6141-8369-40a6-824a-538b0af40674" released by "delete_volume" :: held 0.988s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:21:03 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Created reservations ['4e430c4c-2081-4741-aac4-bd5b8d40fe64', 'bc845086-fd62-41c8-af0d-17fcb6cde7dd', '3473ef52-1ae9-4797-ba9d-b72125333547', '7c154abd-5511-486b-80b3-8dc3d9bc759e'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:21:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:21:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:21:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:21:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:21:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:21:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:03 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:21:03 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:03 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.338s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:03 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:21:03 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Deleted volume successfully. Jul 23 22:21:03 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7f3f33ab-5aa2-4466-b886-e44b6c7d2486 tempest-ServersNegativeTestJSON-204443294 None] Lock "cinder-d81e6141-8369-40a6-824a-538b0af40674-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:21:10 devstack cinder-volume[88308]: WARNING py.warnings [req-2afb6b8d-f05a-4470-bf84-91444e3a79b2 req-a916d95f-8d7f-4b8e-ae64-2d51a880cfbc tempest-TaggedAttachmentsTest-509122766 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 23 22:21:10 devstack cinder-volume[88308]: .first() Jul 23 22:21:10 devstack cinder-volume[88308]: Jul 23 22:21:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-2afb6b8d-f05a-4470-bf84-91444e3a79b2 req-a916d95f-8d7f-4b8e-ae64-2d51a880cfbc tempest-TaggedAttachmentsTest-509122766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:21:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-2afb6b8d-f05a-4470-bf84-91444e3a79b2 req-a916d95f-8d7f-4b8e-ae64-2d51a880cfbc tempest-TaggedAttachmentsTest-509122766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:21:10 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c86157-2d44-4b69-b5bc-2c91e4d4b867]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:21:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-2afb6b8d-f05a-4470-bf84-91444e3a79b2 req-a916d95f-8d7f-4b8e-ae64-2d51a880cfbc tempest-TaggedAttachmentsTest-509122766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:10 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb Jul 23 22:21:10 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:11 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-2afb6b8d-f05a-4470-bf84-91444e3a79b2 req-a916d95f-8d7f-4b8e-ae64-2d51a880cfbc tempest-TaggedAttachmentsTest-509122766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb" returned: 0 in 0.604s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-2afb6b8d-f05a-4470-bf84-91444e3a79b2 req-a916d95f-8d7f-4b8e-ae64-2d51a880cfbc tempest-TaggedAttachmentsTest-509122766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.649s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:21:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-2afb6b8d-f05a-4470-bf84-91444e3a79b2 req-a916d95f-8d7f-4b8e-ae64-2d51a880cfbc tempest-TaggedAttachmentsTest-509122766 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '465fc5e0-9dc6-4265-84c0-3006e1d4786a', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:21:11 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-2afb6b8d-f05a-4470-bf84-91444e3a79b2 req-a916d95f-8d7f-4b8e-ae64-2d51a880cfbc tempest-TaggedAttachmentsTest-509122766 None] attachment_update completed successfully. Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Flow 'volume_create_manager' (c2f006aa-f75a-4d7f-82a3-0204dae3c47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f8cb51-c5b5-4087-8924-8227360df002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f8cb51-c5b5-4087-8924-8227360df002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-417452313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a415c5c2-eb3f-46f1-ba84-2b77fefacdf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1598417d8f4a95875ae58d1a860dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:21:16Z,use_quota=True,user_id='f1d1b0d52fdd4d75b5296903defe7039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0beab8-15f0-4575-be69-5660c29a15d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0beab8-15f0-4575-be69-5660c29a15d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93c904d-362e-4fcd-b9e5-ca9e8bac52ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93c904d-362e-4fcd-b9e5-ca9e8bac52ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a415c5c2-eb3f-46f1-ba84-2b77fefacdf9', 'volume_name': 'volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2b62a4-d779-4b5f-8dc1-c65c33e5b30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2b62a4-d779-4b5f-8dc1-c65c33e5b30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b08e779-9914-4f4a-91ef-eb1eb1e72fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:21:16 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Volume a415c5c2-eb3f-46f1-ba84-2b77fefacdf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9', 'volume_size': 1} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-417452313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a415c5c2-eb3f-46f1-ba84-2b77fefacdf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1598417d8f4a95875ae58d1a860dae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:21:16Z,use_quota=True,user_id='f1d1b0d52fdd4d75b5296903defe7039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Creating volume a415c5c2-eb3f-46f1-ba84-2b77fefacdf9 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:21:16 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:21:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:16 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9 1073741824 Jul 23 22:21:16 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:17 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9 1073741824" returned: 0 in 0.876s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:17 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9 Jul 23 22:21:17 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:17 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9" returned: 0 in 0.534s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:21:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:21:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b08e779-9914-4f4a-91ef-eb1eb1e72fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:21:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a556a0-ea59-42b4-bc8e-64ab8ee9a445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:21:17 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Volume volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9 (a415c5c2-eb3f-46f1-ba84-2b77fefacdf9): created successfully Jul 23 22:21:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a556a0-ea59-42b4-bc8e-64ab8ee9a445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:21:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Flow 'volume_create_manager' (c2f006aa-f75a-4d7f-82a3-0204dae3c47c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:21:17 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-580b859d-3717-4258-856a-e5a821709ee1 tempest-DeleteServersTestJSON-874810610 None] Created volume successfully. Jul 23 22:21:18 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-a9756d59-894c-4cab-be49-c4b5b979e0fc req-cbde9cc4-942c-4da7-a992-2bd9cb1e4e45 tempest-TaggedAttachmentsTest-509122766 None] Terminate volume connection completed successfully. Jul 23 22:21:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-a9756d59-894c-4cab-be49-c4b5b979e0fc req-cbde9cc4-942c-4da7-a992-2bd9cb1e4e45 tempest-TaggedAttachmentsTest-509122766 None] Deleting attachment 465fc5e0-9dc6-4265-84c0-3006e1d4786a. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:21:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-9289ee42-1f1a-4422-8c9d-f97e2d6cab99 req-767f27dc-e402-48f1-a754-69d1f62f081c tempest-DeleteServersTestJSON-874810610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:21:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-9289ee42-1f1a-4422-8c9d-f97e2d6cab99 req-767f27dc-e402-48f1-a754-69d1f62f081c tempest-DeleteServersTestJSON-874810610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:21:21 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d232883-f99e-43d2-a1d3-3e22c8417877]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:21:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-9289ee42-1f1a-4422-8c9d-f97e2d6cab99 req-767f27dc-e402-48f1-a754-69d1f62f081c tempest-DeleteServersTestJSON-874810610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:21 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9 Jul 23 22:21:21 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:21 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-9289ee42-1f1a-4422-8c9d-f97e2d6cab99 req-767f27dc-e402-48f1-a754-69d1f62f081c tempest-DeleteServersTestJSON-874810610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9" returned: 0 in 0.704s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-9289ee42-1f1a-4422-8c9d-f97e2d6cab99 req-767f27dc-e402-48f1-a754-69d1f62f081c tempest-DeleteServersTestJSON-874810610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.736s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:21:21 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=34,cinder:UPDATE=41,cinder:INSERT=8,cinder:DELETE=7 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:21:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-9289ee42-1f1a-4422-8c9d-f97e2d6cab99 req-767f27dc-e402-48f1-a754-69d1f62f081c tempest-DeleteServersTestJSON-874810610 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00d21ef2-02c2-4781-83d8-9654f7ef2791', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:21:21 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-9289ee42-1f1a-4422-8c9d-f97e2d6cab99 req-767f27dc-e402-48f1-a754-69d1f62f081c tempest-DeleteServersTestJSON-874810610 None] attachment_update completed successfully. Jul 23 22:21:25 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:21:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:21:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:21:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:21:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:21:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:21:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:26 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:21:26 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:26 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.357s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:21:28 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-afc5e833-dc4a-4980-a4ca-fa30eaf3cd55 req-fbfe3a0c-b202-4f94-aae5-2798162ca0e0 tempest-DeleteServersTestJSON-874810610 None] Terminate volume connection completed successfully. Jul 23 22:21:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-afc5e833-dc4a-4980-a4ca-fa30eaf3cd55 req-fbfe3a0c-b202-4f94-aae5-2798162ca0e0 tempest-DeleteServersTestJSON-874810610 None] Deleting attachment 00d21ef2-02c2-4781-83d8-9654f7ef2791. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:21:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Acquiring lock "cinder-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:21:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Lock "cinder-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:21:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Acquiring lock "cinder-quobyte-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:21:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Lock "cinder-quobyte-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9" acquired by "delete_volume" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:21:30 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afd5631-4a2a-4097-91a8-bef39035ed17]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:21:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:30 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9 Jul 23 22:21:30 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:31 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9" returned: 0 in 0.443s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:31 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9 Jul 23 22:21:31 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:31 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9" returned: 0 in 0.259s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Lock "cinder-quobyte-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9" released by "delete_volume" :: held 0.762s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:21:31 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Created reservations ['92b116ca-c894-4c48-a403-5c717f1e59ad', '6bf3bb35-7528-4156-9c76-fd67460947c8', 'e2467665-f19b-40ca-b0df-f7206bd7a68e', '07ad5612-c57b-4313-83bd-0a46a7f04e9f'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:21:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:21:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:21:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:21:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:21:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:21:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:31 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:21:31 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:31 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.343s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:31 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:21:31 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Deleted volume successfully. Jul 23 22:21:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a7417868-597e-48c6-b024-5ad05acd6e08 tempest-DeleteServersTestJSON-874810610 None] Lock "cinder-a415c5c2-eb3f-46f1-ba84-2b77fefacdf9-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:21:41 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=36,cinder:UPDATE=33,cinder:INSERT=8 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:21:41 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:UPDATE=9,cinder:SELECT=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:21:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Acquiring lock "cinder-53bc3402-61cd-48a7-bab3-0076f33cf7bb-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:21:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Lock "cinder-53bc3402-61cd-48a7-bab3-0076f33cf7bb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:21:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Acquiring lock "cinder-quobyte-53bc3402-61cd-48a7-bab3-0076f33cf7bb" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:21:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Lock "cinder-quobyte-53bc3402-61cd-48a7-bab3-0076f33cf7bb" acquired by "delete_volume" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:21:43 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6b5f61-b489-4571-a31a-d097da24a6d5]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:21:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:43 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb Jul 23 22:21:43 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:44 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb" returned: 0 in 0.492s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:44 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb Jul 23 22:21:44 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:44 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-53bc3402-61cd-48a7-bab3-0076f33cf7bb" returned: 0 in 0.310s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Lock "cinder-quobyte-53bc3402-61cd-48a7-bab3-0076f33cf7bb" released by "delete_volume" :: held 0.863s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:21:44 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Created reservations ['d7fb251c-c017-47d9-b14c-6728847ed240', '162eb934-9ad8-4a57-83f2-c9c919fd1076', '044ce27b-5008-49bf-a194-c0bd64fea54b', '0a545dfb-e8e5-43de-9d88-f4d0f68cf360'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:21:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:21:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:21:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:21:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:21:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:21:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:21:44 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:21:44 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:21:44 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Jul 23 22:21:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.261s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:21:44 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:21:44 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Deleted volume successfully. Jul 23 22:21:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c2c1e2eb-9125-4c6c-81c1-e553fca28e69 tempest-TaggedAttachmentsTest-509122766 None] Lock "cinder-53bc3402-61cd-48a7-bab3-0076f33cf7bb-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:21:54 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:21:54 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Flow 'volume_create_manager' (f5acc90c-1065-4a4a-990c-f47073057c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213193ba-9e12-4f02-8759-9f194ad2d8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213193ba-9e12-4f02-8759-9f194ad2d8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-266636498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47901ade9bf046a58e778d14dd89f72b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:22:21Z,use_quota=True,user_id='e73427b6d501451ebe5b1ec508c40c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc91f0e-a87a-409f-a155-7810aa92c6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc91f0e-a87a-409f-a155-7810aa92c6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353690fe-f5de-4f37-9f46-c6680eb85ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353690fe-f5de-4f37-9f46-c6680eb85ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453', 'volume_name': 'volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9be794-5e67-4683-88ab-7122b02c8c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9be794-5e67-4683-88ab-7122b02c8c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c4a782-e4cd-4608-9465-be70b4698546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:21 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Volume a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453', 'volume_size': 1} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-266636498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47901ade9bf046a58e778d14dd89f72b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:22:21Z,use_quota=True,user_id='e73427b6d501451ebe5b1ec508c40c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Creating volume a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:22:21 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:22:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:22:21 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453 1073741824 Jul 23 22:22:21 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:22:22 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:22:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Flow 'volume_create_manager' (4959c523-02f8-4ce3-a7b6-348de970bcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:22:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79239fe7-1a66-4258-b6b0-517f17e2d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79239fe7-1a66-4258-b6b0-517f17e2d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1262164320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d89abb-d46d-4a16-96aa-872b85d58f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceeba8eddb841cc9495499210c4d9c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:22:22Z,use_quota=True,user_id='b0be5df9a44c4a8fafb1657b501c25fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce812082-b9b9-4e9f-b994-e11dfd1e64f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce812082-b9b9-4e9f-b994-e11dfd1e64f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd58379d-7467-46ec-9a0a-0b266b730f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd58379d-7467-46ec-9a0a-0b266b730f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08d89abb-d46d-4a16-96aa-872b85d58f95', 'volume_name': 'volume-08d89abb-d46d-4a16-96aa-872b85d58f95', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8af5bd-4c4c-4e36-b88d-5a1921d6aed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8af5bd-4c4c-4e36-b88d-5a1921d6aed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77458f4-f793-4e82-9c54-cf11af31b62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:22 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Volume 08d89abb-d46d-4a16-96aa-872b85d58f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08d89abb-d46d-4a16-96aa-872b85d58f95', 'volume_size': 1} Jul 23 22:22:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:22:22 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Jul 23 22:22:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453 1073741824" returned: 0 in 0.900s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:22:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:22:22 devstack sudo[91760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453 Jul 23 22:22:22 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:22:23 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453" returned: 0 in 0.537s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1262164320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d89abb-d46d-4a16-96aa-872b85d58f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceeba8eddb841cc9495499210c4d9c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:22:22Z,use_quota=True,user_id='b0be5df9a44c4a8fafb1657b501c25fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Creating volume 08d89abb-d46d-4a16-96aa-872b85d58f95 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:22:23 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08d89abb-d46d-4a16-96aa-872b85d58f95 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c4a782-e4cd-4608-9465-be70b4698546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:23 devstack sudo[91763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08d89abb-d46d-4a16-96aa-872b85d58f95 1073741824 Jul 23 22:22:23 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15328580-4bf1-413f-a703-d590144e9def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:23 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Volume volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453 (a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453): created successfully Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15328580-4bf1-413f-a703-d590144e9def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Flow 'volume_create_manager' (f5acc90c-1065-4a4a-990c-f47073057c3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:22:23 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c50f3f65-547d-4d59-9396-49aa67c5280e tempest-ServerActionsTestOtherA-1328799028 None] Created volume successfully. Jul 23 22:22:24 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root Jul 23 22:22:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08d89abb-d46d-4a16-96aa-872b85d58f95 1073741824" returned: 0 in 0.990s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:22:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08d89abb-d46d-4a16-96aa-872b85d58f95 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:22:24 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08d89abb-d46d-4a16-96aa-872b85d58f95 Jul 23 22:22:24 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:22:25 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Jul 23 22:22:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08d89abb-d46d-4a16-96aa-872b85d58f95" returned: 0 in 0.710s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:22:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:22:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:22:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77458f4-f793-4e82-9c54-cf11af31b62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08d89abb-d46d-4a16-96aa-872b85d58f95', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4994de48-9db5-485a-b61a-3cc72b166066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:25 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Volume volume-08d89abb-d46d-4a16-96aa-872b85d58f95 (08d89abb-d46d-4a16-96aa-872b85d58f95): created successfully Jul 23 22:22:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4994de48-9db5-485a-b61a-3cc72b166066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Flow 'volume_create_manager' (4959c523-02f8-4ce3-a7b6-348de970bcda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:22:25 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-744e23f5-d3a5-456d-933f-b3a3c986376b tempest-AttachVolumeTestJSON-111733113 None] Created volume successfully. Jul 23 22:22:25 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:22:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:22:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:22:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:22:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:22:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:22:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:22:26 devstack sudo[91777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:22:26 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:22:26 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root Jul 23 22:22:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.857s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:22:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:22:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:22:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 8 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:22:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:22:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-7af1f6e5-8ef0-46d7-a8fb-11b5e13501aa req-79422948-bb7f-4bce-af74-90cfb50fc60d tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:22:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-7af1f6e5-8ef0-46d7-a8fb-11b5e13501aa req-79422948-bb7f-4bce-af74-90cfb50fc60d tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:22:27 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[226eea0c-81a4-48e6-87c2-edb6ec413945]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:22:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-7af1f6e5-8ef0-46d7-a8fb-11b5e13501aa req-79422948-bb7f-4bce-af74-90cfb50fc60d tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08d89abb-d46d-4a16-96aa-872b85d58f95 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:22:27 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08d89abb-d46d-4a16-96aa-872b85d58f95 Jul 23 22:22:27 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:22:28 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Jul 23 22:22:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-7af1f6e5-8ef0-46d7-a8fb-11b5e13501aa req-79422948-bb7f-4bce-af74-90cfb50fc60d tempest-AttachVolumeTestJSON-111733113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08d89abb-d46d-4a16-96aa-872b85d58f95" returned: 0 in 0.795s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:22:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-7af1f6e5-8ef0-46d7-a8fb-11b5e13501aa req-79422948-bb7f-4bce-af74-90cfb50fc60d tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.835s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:22:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-7af1f6e5-8ef0-46d7-a8fb-11b5e13501aa req-79422948-bb7f-4bce-af74-90cfb50fc60d tempest-AttachVolumeTestJSON-111733113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-08d89abb-d46d-4a16-96aa-872b85d58f95', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46048eb3-bfc5-432c-b698-24bfe45943aa', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:22:28 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-7af1f6e5-8ef0-46d7-a8fb-11b5e13501aa req-79422948-bb7f-4bce-af74-90cfb50fc60d tempest-AttachVolumeTestJSON-111733113 None] attachment_update completed successfully. Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Flow 'volume_create_manager' (c3609ce9-73fb-4efb-89f6-8bb9f10b8095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df54e366-5b32-4ca4-b03c-7237cb4fb4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df54e366-5b32-4ca4-b03c-7237cb4fb4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-972140563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978929f9-c4b3-4402-a27a-846f16e7c816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b70683d6194c65a6bde18df0939eb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:22:31Z,use_quota=True,user_id='8d4ebbb692a244009bc5e45914c4c6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec5c215-328f-4fcf-8943-26c024e57c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec5c215-328f-4fcf-8943-26c024e57c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c836604-251c-4561-872f-15de84a87986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c836604-251c-4561-872f-15de84a87986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '978929f9-c4b3-4402-a27a-846f16e7c816', 'volume_name': 'volume-978929f9-c4b3-4402-a27a-846f16e7c816', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea452727-22ae-4e00-89a4-cae11dde00df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea452727-22ae-4e00-89a4-cae11dde00df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d62c85f-128a-4f61-89ef-619ff3ee88cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:31 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Volume 978929f9-c4b3-4402-a27a-846f16e7c816: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-978929f9-c4b3-4402-a27a-846f16e7c816', 'volume_size': 1} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-972140563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978929f9-c4b3-4402-a27a-846f16e7c816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b70683d6194c65a6bde18df0939eb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:22:31Z,use_quota=True,user_id='8d4ebbb692a244009bc5e45914c4c6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Creating volume 978929f9-c4b3-4402-a27a-846f16e7c816 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:22:31 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:22:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-978929f9-c4b3-4402-a27a-846f16e7c816 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:22:31 devstack sudo[92212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-978929f9-c4b3-4402-a27a-846f16e7c816 1073741824 Jul 23 22:22:31 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:22:32 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root Jul 23 22:22:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-978929f9-c4b3-4402-a27a-846f16e7c816 1073741824" returned: 0 in 0.876s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:22:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-978929f9-c4b3-4402-a27a-846f16e7c816 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:22:32 devstack sudo[92226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-978929f9-c4b3-4402-a27a-846f16e7c816 Jul 23 22:22:32 devstack sudo[92226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:22:32 devstack sudo[92226]: pam_unix(sudo:session): session closed for user root Jul 23 22:22:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-978929f9-c4b3-4402-a27a-846f16e7c816" returned: 0 in 0.327s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:22:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:22:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:22:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d62c85f-128a-4f61-89ef-619ff3ee88cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-978929f9-c4b3-4402-a27a-846f16e7c816', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ddcbd5-1b78-4188-bc4a-d69cda303b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:22:32 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Volume volume-978929f9-c4b3-4402-a27a-846f16e7c816 (978929f9-c4b3-4402-a27a-846f16e7c816): created successfully Jul 23 22:22:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ddcbd5-1b78-4188-bc4a-d69cda303b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:22:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Flow 'volume_create_manager' (c3609ce9-73fb-4efb-89f6-8bb9f10b8095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:22:32 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-04facf97-3093-4290-9b00-77c36d197851 tempest-ServerRescueNegativeTestJSON-468533437 None] Created volume successfully. Jul 23 22:22:42 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=11,cinder:UPDATE=12,cinder:INSERT=1 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:22:42 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=12,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=3 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:22:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Acquiring lock "cinder-978929f9-c4b3-4402-a27a-846f16e7c816-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:22:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Lock "cinder-978929f9-c4b3-4402-a27a-846f16e7c816-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:22:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Acquiring lock "cinder-quobyte-978929f9-c4b3-4402-a27a-846f16e7c816" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:22:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Lock "cinder-quobyte-978929f9-c4b3-4402-a27a-846f16e7c816" acquired by "delete_volume" :: waited 0.035s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:22:55 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bada04-3b65-4936-a0b8-b11cf7290b6e]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:22:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-978929f9-c4b3-4402-a27a-846f16e7c816 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:22:56 devstack sudo[93077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-978929f9-c4b3-4402-a27a-846f16e7c816 Jul 23 22:22:56 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:22:56 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root Jul 23 22:22:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-978929f9-c4b3-4402-a27a-846f16e7c816" returned: 0 in 0.438s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:22:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-978929f9-c4b3-4402-a27a-846f16e7c816 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:22:56 devstack sudo[93082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-978929f9-c4b3-4402-a27a-846f16e7c816 Jul 23 22:22:56 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:22:56 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root Jul 23 22:22:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-978929f9-c4b3-4402-a27a-846f16e7c816" returned: 0 in 0.342s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:22:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Lock "cinder-quobyte-978929f9-c4b3-4402-a27a-846f16e7c816" released by "delete_volume" :: held 0.843s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:22:56 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Created reservations ['265c3197-ac38-4b08-ad55-258548accb63', '36360c79-78cd-4b33-95ff-0e04a1303a3a', 'af53fc48-1327-42a4-aebf-32f250a4a075', '5ae7de7e-a552-477e-a8c3-a76a06ae3839'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:22:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:22:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:22:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:22:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:22:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:22:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:22:56 devstack sudo[93085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:22:56 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:22:57 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root Jul 23 22:22:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.542s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:22:57 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:22:57 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Deleted volume successfully. Jul 23 22:22:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-16a78598-af9d-4352-b5bd-24bace5c8fff tempest-ServerRescueNegativeTestJSON-468533437 None] Lock "cinder-978929f9-c4b3-4402-a27a-846f16e7c816-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:23:10 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:23:11 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:UPDATE=11,cinder:SELECT=2,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:23:12 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Flow 'volume_create_manager' (df8ab7fb-412d-487b-87de-d01050e877b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c8cbe4-b91e-48b4-86fa-d45ad11a9eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c8cbe4-b91e-48b4-86fa-d45ad11a9eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1378835380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914d752d-f50a-4f7f-9b22-7994812223cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='387b219f3bc54342b4c57eb08dc959e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:23:13Z,use_quota=True,user_id='0efec106e8a14b36a2df6da787d125df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e49c3d-2634-4303-9f6f-589e13d9a231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e49c3d-2634-4303-9f6f-589e13d9a231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11370ca-c253-4f8e-a5d7-44c28b3fd967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11370ca-c253-4f8e-a5d7-44c28b3fd967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '914d752d-f50a-4f7f-9b22-7994812223cd', 'volume_name': 'volume-914d752d-f50a-4f7f-9b22-7994812223cd', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aae6d16-3579-4373-abf4-9521fce14f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aae6d16-3579-4373-abf4-9521fce14f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371be006-4ac6-4424-aa26-e00d152f9302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:13 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Volume 914d752d-f50a-4f7f-9b22-7994812223cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-914d752d-f50a-4f7f-9b22-7994812223cd', 'volume_size': 1} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1378835380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914d752d-f50a-4f7f-9b22-7994812223cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='387b219f3bc54342b4c57eb08dc959e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:23:13Z,use_quota=True,user_id='0efec106e8a14b36a2df6da787d125df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Creating volume 914d752d-f50a-4f7f-9b22-7994812223cd {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:23:13 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-914d752d-f50a-4f7f-9b22-7994812223cd 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:13 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-914d752d-f50a-4f7f-9b22-7994812223cd 1073741824 Jul 23 22:23:13 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:13 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-914d752d-f50a-4f7f-9b22-7994812223cd 1073741824" returned: 0 in 0.394s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-914d752d-f50a-4f7f-9b22-7994812223cd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:13 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-914d752d-f50a-4f7f-9b22-7994812223cd Jul 23 22:23:13 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:13 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-914d752d-f50a-4f7f-9b22-7994812223cd" returned: 0 in 0.238s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371be006-4ac6-4424-aa26-e00d152f9302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-914d752d-f50a-4f7f-9b22-7994812223cd', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a3755d-762c-4b10-b9c4-75b94dcc0021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:13 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Volume volume-914d752d-f50a-4f7f-9b22-7994812223cd (914d752d-f50a-4f7f-9b22-7994812223cd): created successfully Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a3755d-762c-4b10-b9c4-75b94dcc0021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Flow 'volume_create_manager' (df8ab7fb-412d-487b-87de-d01050e877b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:23:13 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-e2575d93-7cf1-44dc-a3b3-f634cfed5157 req-df08ce5b-d9f5-469b-bc62-ed9e4aa48309 tempest-VolumesGetTestJSON-1962994887 None] Created volume successfully. Jul 23 22:23:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Acquiring lock "cinder-914d752d-f50a-4f7f-9b22-7994812223cd-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:23:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Lock "cinder-914d752d-f50a-4f7f-9b22-7994812223cd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:23:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Acquiring lock "cinder-quobyte-914d752d-f50a-4f7f-9b22-7994812223cd" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:23:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Lock "cinder-quobyte-914d752d-f50a-4f7f-9b22-7994812223cd" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:23:14 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a382977-730c-4dfa-aefe-8fcc0ddd0c70]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:23:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-914d752d-f50a-4f7f-9b22-7994812223cd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:14 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-914d752d-f50a-4f7f-9b22-7994812223cd Jul 23 22:23:14 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:14 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-914d752d-f50a-4f7f-9b22-7994812223cd" returned: 0 in 0.380s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-914d752d-f50a-4f7f-9b22-7994812223cd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:14 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-914d752d-f50a-4f7f-9b22-7994812223cd Jul 23 22:23:14 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:15 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-914d752d-f50a-4f7f-9b22-7994812223cd" returned: 0 in 0.256s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Lock "cinder-quobyte-914d752d-f50a-4f7f-9b22-7994812223cd" released by "delete_volume" :: held 0.678s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:23:15 devstack cinder-volume[88308]: DEBUG cinder.quota [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Created reservations ['eb9e43a1-be4b-420f-9f60-2f1a43e5c49a', '204ec28c-a625-4390-a360-09202f678a91', 'd9ebcc28-b72a-4921-9e83-8f38c3eb9670', 'f70885a0-8eee-4788-bc5a-ac61f8a095c1'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:23:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:23:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:23:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:15 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:23:15 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:15 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.254s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:15 devstack cinder-volume[88308]: DEBUG cinder.manager [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:23:15 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Deleted volume successfully. Jul 23 22:23:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-f97a59e7-8893-445c-bc6d-6377065d5687 req-9de52b45-b392-4de4-b0ac-c9a14046f386 tempest-VolumesGetTestJSON-1962994887 None] Lock "cinder-914d752d-f50a-4f7f-9b22-7994812223cd-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:23:18 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:23:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Flow 'volume_create_manager' (3db35f11-9e40-4ff1-b063-9523b75ab103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:23:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d4c523-435a-47ea-b0d5-79ebfcf2c07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d4c523-435a-47ea-b0d5-79ebfcf2c07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1868596033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4301187-45f8-4147-b87b-1fbe8d13df19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61bfe20e03f84f5182bd60d825a13b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:23:19Z,use_quota=True,user_id='feb2fd3cb261483b9e252071b7bd1ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8896494-bb8f-4ddd-a626-8354465e0147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8896494-bb8f-4ddd-a626-8354465e0147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394ee39e-4d43-4715-b11d-d6a12c1ce2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394ee39e-4d43-4715-b11d-d6a12c1ce2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4301187-45f8-4147-b87b-1fbe8d13df19', 'volume_name': 'volume-e4301187-45f8-4147-b87b-1fbe8d13df19', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee76445-19ff-4d57-a109-17bd459b00c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee76445-19ff-4d57-a109-17bd459b00c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8a72ac-6240-482f-90fb-f9fc942b5001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:19 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Volume e4301187-45f8-4147-b87b-1fbe8d13df19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4301187-45f8-4147-b87b-1fbe8d13df19', 'volume_size': 1} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1868596033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4301187-45f8-4147-b87b-1fbe8d13df19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61bfe20e03f84f5182bd60d825a13b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:23:19Z,use_quota=True,user_id='feb2fd3cb261483b9e252071b7bd1ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Creating volume e4301187-45f8-4147-b87b-1fbe8d13df19 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:23:19 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e4301187-45f8-4147-b87b-1fbe8d13df19 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:19 devstack sudo[93331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e4301187-45f8-4147-b87b-1fbe8d13df19 1073741824 Jul 23 22:23:19 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:19 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e4301187-45f8-4147-b87b-1fbe8d13df19 1073741824" returned: 0 in 0.438s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e4301187-45f8-4147-b87b-1fbe8d13df19 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:19 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e4301187-45f8-4147-b87b-1fbe8d13df19 Jul 23 22:23:19 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:19 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e4301187-45f8-4147-b87b-1fbe8d13df19" returned: 0 in 0.254s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8a72ac-6240-482f-90fb-f9fc942b5001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4301187-45f8-4147-b87b-1fbe8d13df19', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0219f1d-aec1-4fd0-baa2-caa5ab7887ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:19 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Volume volume-e4301187-45f8-4147-b87b-1fbe8d13df19 (e4301187-45f8-4147-b87b-1fbe8d13df19): created successfully Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0219f1d-aec1-4fd0-baa2-caa5ab7887ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Flow 'volume_create_manager' (3db35f11-9e40-4ff1-b063-9523b75ab103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:23:19 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ec9da88b-c9a6-4bb0-b787-7dbb3dc73a9d tempest-VolumesTestJSON-502685364 None] Created volume successfully. Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Flow 'volume_create_manager' (5484fe74-7e43-4f5f-a4cd-60e07b6f5add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf732c1-5d02-46e7-b5d9-9e77e0c63dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf732c1-5d02-46e7-b5d9-9e77e0c63dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-383106541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ab8444-b900-4a42-898d-aeb5a5957b5d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61bfe20e03f84f5182bd60d825a13b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:23:20Z,use_quota=True,user_id='feb2fd3cb261483b9e252071b7bd1ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a876b656-e1b1-4b88-b014-aaf3b30b7892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a876b656-e1b1-4b88-b014-aaf3b30b7892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e94cade-3526-4c41-860d-8317569af84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e94cade-3526-4c41-860d-8317569af84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ab8444-b900-4a42-898d-aeb5a5957b5d', 'volume_name': 'volume-a0ab8444-b900-4a42-898d-aeb5a5957b5d', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a41f3e-c798-42e4-a84e-3aa812bde70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a41f3e-c798-42e4-a84e-3aa812bde70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de43c7cb-36a7-43f7-87fb-50dbb19f9d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:20 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Volume a0ab8444-b900-4a42-898d-aeb5a5957b5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ab8444-b900-4a42-898d-aeb5a5957b5d', 'volume_size': 1} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-383106541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ab8444-b900-4a42-898d-aeb5a5957b5d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61bfe20e03f84f5182bd60d825a13b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:23:20Z,use_quota=True,user_id='feb2fd3cb261483b9e252071b7bd1ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Creating volume a0ab8444-b900-4a42-898d-aeb5a5957b5d {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:23:20 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a0ab8444-b900-4a42-898d-aeb5a5957b5d 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:20 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a0ab8444-b900-4a42-898d-aeb5a5957b5d 1073741824 Jul 23 22:23:20 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Flow 'volume_create_manager' (17fe5732-749c-4f23-b59a-72e374cba646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e822448-c9fb-4627-b1b1-7cf0d493c33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e822448-c9fb-4627-b1b1-7cf0d493c33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1930930218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed53169-ce47-4a05-a604-cd5c7c6cd35c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90de91f1d74141588dcc7fa0c15fe7b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:23:21Z,use_quota=True,user_id='0d8ca98f5af24b62acb48b48c0d49a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26390752-c56d-459f-b6d9-9182d89af658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26390752-c56d-459f-b6d9-9182d89af658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55bf77cb-24ad-46dc-9a9f-bfff67a52bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55bf77cb-24ad-46dc-9a9f-bfff67a52bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed53169-ce47-4a05-a604-cd5c7c6cd35c', 'volume_name': 'volume-eed53169-ce47-4a05-a604-cd5c7c6cd35c', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab36674-1457-4769-910d-5b27cc718aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab36674-1457-4769-910d-5b27cc718aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85165f13-e9a3-499a-88da-ff1a0cc9ffd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:20 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Volume eed53169-ce47-4a05-a604-cd5c7c6cd35c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed53169-ce47-4a05-a604-cd5c7c6cd35c', 'volume_size': 1} Jul 23 22:23:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:21 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a0ab8444-b900-4a42-898d-aeb5a5957b5d 1073741824" returned: 0 in 0.420s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a0ab8444-b900-4a42-898d-aeb5a5957b5d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:21 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a0ab8444-b900-4a42-898d-aeb5a5957b5d Jul 23 22:23:21 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:21 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a0ab8444-b900-4a42-898d-aeb5a5957b5d" returned: 0 in 0.240s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.544s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1930930218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed53169-ce47-4a05-a604-cd5c7c6cd35c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90de91f1d74141588dcc7fa0c15fe7b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:23:21Z,use_quota=True,user_id='0d8ca98f5af24b62acb48b48c0d49a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Creating volume eed53169-ce47-4a05-a604-cd5c7c6cd35c {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:23:21 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eed53169-ce47-4a05-a604-cd5c7c6cd35c 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de43c7cb-36a7-43f7-87fb-50dbb19f9d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ab8444-b900-4a42-898d-aeb5a5957b5d', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c40f202-82bc-4922-9ece-6de11f655a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:21 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eed53169-ce47-4a05-a604-cd5c7c6cd35c 1073741824 Jul 23 22:23:21 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:21 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Volume volume-a0ab8444-b900-4a42-898d-aeb5a5957b5d (a0ab8444-b900-4a42-898d-aeb5a5957b5d): created successfully Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c40f202-82bc-4922-9ece-6de11f655a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Flow 'volume_create_manager' (5484fe74-7e43-4f5f-a4cd-60e07b6f5add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:23:21 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-240e5977-809a-44e9-a3a7-7b8b45b712c3 tempest-VolumesTestJSON-502685364 None] Created volume successfully. Jul 23 22:23:21 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eed53169-ce47-4a05-a604-cd5c7c6cd35c 1073741824" returned: 0 in 0.501s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eed53169-ce47-4a05-a604-cd5c7c6cd35c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:21 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eed53169-ce47-4a05-a604-cd5c7c6cd35c Jul 23 22:23:21 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Flow 'volume_create_manager' (2022c987-3797-4232-a7fb-a246d25dcf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854efdec-b69a-442b-9844-19b3c4f215cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:22 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854efdec-b69a-442b-9844-19b3c4f215cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1078915786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68fa9886-d399-4164-a98f-5fc77ce451ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61bfe20e03f84f5182bd60d825a13b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:23:22Z,use_quota=True,user_id='feb2fd3cb261483b9e252071b7bd1ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3acaff93-5e1d-40ac-8685-e9add8d26c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3acaff93-5e1d-40ac-8685-e9add8d26c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c6012b-c854-45a1-965f-ecbd97eb9908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c6012b-c854-45a1-965f-ecbd97eb9908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68fa9886-d399-4164-a98f-5fc77ce451ec', 'volume_name': 'volume-68fa9886-d399-4164-a98f-5fc77ce451ec', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8dbf09c-b746-4ad4-b6e2-7d388c44efbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8dbf09c-b746-4ad4-b6e2-7d388c44efbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a49ea6-1ae3-46e3-93fe-3c13d7f0637c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:22 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Volume 68fa9886-d399-4164-a98f-5fc77ce451ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68fa9886-d399-4164-a98f-5fc77ce451ec', 'volume_size': 1} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eed53169-ce47-4a05-a604-cd5c7c6cd35c" returned: 0 in 0.372s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1078915786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68fa9886-d399-4164-a98f-5fc77ce451ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='61bfe20e03f84f5182bd60d825a13b1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:23:22Z,use_quota=True,user_id='feb2fd3cb261483b9e252071b7bd1ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Creating volume 68fa9886-d399-4164-a98f-5fc77ce451ec {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:23:22 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-68fa9886-d399-4164-a98f-5fc77ce451ec 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85165f13-e9a3-499a-88da-ff1a0cc9ffd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed53169-ce47-4a05-a604-cd5c7c6cd35c', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f3375f-a404-4666-af3f-10432e80d377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:22 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-68fa9886-d399-4164-a98f-5fc77ce451ec 1073741824 Jul 23 22:23:22 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:22 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Volume volume-eed53169-ce47-4a05-a604-cd5c7c6cd35c (eed53169-ce47-4a05-a604-cd5c7c6cd35c): created successfully Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f3375f-a404-4666-af3f-10432e80d377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Flow 'volume_create_manager' (17fe5732-749c-4f23-b59a-72e374cba646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:23:22 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-fa84fbbb-125f-44c9-99b1-29d2b648ab04 tempest-AttachVolumeShelveTestJSON-1177938564 None] Created volume successfully. Jul 23 22:23:22 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-6e8c86e9-3c2b-41d2-88cd-e98925fa7dc3 req-a6aa5428-1c09-487a-ad0a-03782db0a0b8 tempest-AttachVolumeTestJSON-111733113 None] Terminate volume connection completed successfully. Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-6e8c86e9-3c2b-41d2-88cd-e98925fa7dc3 req-a6aa5428-1c09-487a-ad0a-03782db0a0b8 tempest-AttachVolumeTestJSON-111733113 None] Deleting attachment 46048eb3-bfc5-432c-b698-24bfe45943aa. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:23:22 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-68fa9886-d399-4164-a98f-5fc77ce451ec 1073741824" returned: 0 in 0.466s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-68fa9886-d399-4164-a98f-5fc77ce451ec {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:22 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-68fa9886-d399-4164-a98f-5fc77ce451ec Jul 23 22:23:22 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:23 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-68fa9886-d399-4164-a98f-5fc77ce451ec" returned: 0 in 0.272s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:23:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a49ea6-1ae3-46e3-93fe-3c13d7f0637c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68fa9886-d399-4164-a98f-5fc77ce451ec', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddabccca-5ae4-4499-9cce-b26ef71969b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:23 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Volume volume-68fa9886-d399-4164-a98f-5fc77ce451ec (68fa9886-d399-4164-a98f-5fc77ce451ec): created successfully Jul 23 22:23:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddabccca-5ae4-4499-9cce-b26ef71969b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Flow 'volume_create_manager' (2022c987-3797-4232-a7fb-a246d25dcf24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:23:23 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-69fa9682-2e5f-41d6-88b2-768d0ceacb8f tempest-VolumesTestJSON-502685364 None] Created volume successfully. Jul 23 22:23:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Acquiring lock "cinder-68fa9886-d399-4164-a98f-5fc77ce451ec-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:23:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Lock "cinder-68fa9886-d399-4164-a98f-5fc77ce451ec-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:23:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Acquiring lock "cinder-quobyte-68fa9886-d399-4164-a98f-5fc77ce451ec" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:23:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Lock "cinder-quobyte-68fa9886-d399-4164-a98f-5fc77ce451ec" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:23:25 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a13f987-de9e-4964-ad70-56412e995fe1]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:23:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-68fa9886-d399-4164-a98f-5fc77ce451ec {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:25 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-68fa9886-d399-4164-a98f-5fc77ce451ec Jul 23 22:23:25 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:25 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-68fa9886-d399-4164-a98f-5fc77ce451ec" returned: 0 in 0.546s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-68fa9886-d399-4164-a98f-5fc77ce451ec {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:25 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-68fa9886-d399-4164-a98f-5fc77ce451ec Jul 23 22:23:25 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:26 devstack sudo[93432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:23:26 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:26 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-68fa9886-d399-4164-a98f-5fc77ce451ec" returned: 0 in 0.334s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Lock "cinder-quobyte-68fa9886-d399-4164-a98f-5fc77ce451ec" released by "delete_volume" :: held 0.974s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Created reservations ['1e3eac0e-c3e8-4752-8057-d0bfa5eecf93', '1a6d85a4-7cae-4a3a-a3ab-a627ae124a58', '1f84fa06-2c8c-43dc-8b6d-08452aa91d6d', '2a194a46-3a70-4c03-8bb4-4970d063c042'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:23:26 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.460s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 8 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:26 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:23:26 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:26 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.360s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:23:26 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Deleted volume successfully. Jul 23 22:23:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e8ecbeff-0ea1-4285-a7df-1912b8879eda tempest-VolumesTestJSON-502685364 None] Lock "cinder-68fa9886-d399-4164-a98f-5fc77ce451ec-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:23:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Acquiring lock "cinder-a0ab8444-b900-4a42-898d-aeb5a5957b5d-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:23:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Lock "cinder-a0ab8444-b900-4a42-898d-aeb5a5957b5d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:23:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Acquiring lock "cinder-quobyte-a0ab8444-b900-4a42-898d-aeb5a5957b5d" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:23:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Lock "cinder-quobyte-a0ab8444-b900-4a42-898d-aeb5a5957b5d" acquired by "delete_volume" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:23:27 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3203ba4-adb7-4ddc-bdd5-5f86d2b2683f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:23:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a0ab8444-b900-4a42-898d-aeb5a5957b5d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:27 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a0ab8444-b900-4a42-898d-aeb5a5957b5d Jul 23 22:23:28 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:28 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a0ab8444-b900-4a42-898d-aeb5a5957b5d" returned: 0 in 0.606s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a0ab8444-b900-4a42-898d-aeb5a5957b5d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:28 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a0ab8444-b900-4a42-898d-aeb5a5957b5d Jul 23 22:23:28 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:28 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a0ab8444-b900-4a42-898d-aeb5a5957b5d" returned: 0 in 0.269s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Lock "cinder-quobyte-a0ab8444-b900-4a42-898d-aeb5a5957b5d" released by "delete_volume" :: held 0.950s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:23:28 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Created reservations ['b64450dd-1b37-447c-96e7-fc45adb8c88e', '8164172d-6ef9-4646-8ed8-2f151cb74bde', 'b3e0e879-547b-465e-bb31-8bde05ecafac', '725a3db0-fb22-4bb8-a3f0-6e268b754b53'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:23:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:28 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:23:28 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:23:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:28 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:23:28 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Acquiring lock "cinder-e4301187-45f8-4147-b87b-1fbe8d13df19-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:23:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Lock "cinder-e4301187-45f8-4147-b87b-1fbe8d13df19-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:23:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Acquiring lock "cinder-quobyte-e4301187-45f8-4147-b87b-1fbe8d13df19" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:23:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Lock "cinder-quobyte-e4301187-45f8-4147-b87b-1fbe8d13df19" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:23:29 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b437569d-fbb4-44e6-a996-d076533e88b1]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:23:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e4301187-45f8-4147-b87b-1fbe8d13df19 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:29 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e4301187-45f8-4147-b87b-1fbe8d13df19 Jul 23 22:23:29 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:29 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.426s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:29 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:23:29 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Deleted volume successfully. Jul 23 22:23:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7ee5e93c-5cc7-4b62-81b9-3a1b8c2099bc tempest-VolumesTestJSON-502685364 None] Lock "cinder-a0ab8444-b900-4a42-898d-aeb5a5957b5d-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:23:29 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e4301187-45f8-4147-b87b-1fbe8d13df19" returned: 0 in 0.600s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e4301187-45f8-4147-b87b-1fbe8d13df19 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:29 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e4301187-45f8-4147-b87b-1fbe8d13df19 Jul 23 22:23:29 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:30 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e4301187-45f8-4147-b87b-1fbe8d13df19" returned: 0 in 0.396s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Lock "cinder-quobyte-e4301187-45f8-4147-b87b-1fbe8d13df19" released by "delete_volume" :: held 1.071s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:23:30 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Created reservations ['33121d96-ed31-4c25-abad-930e7e91820e', '61d19e24-532e-403e-a6ac-7ee8a483c233', '384df176-a6c8-404b-8647-070c13af341f', '168e4989-f12e-4192-afd1-de1919400758'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:23:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:23:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:23:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:30 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:23:30 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:30 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.372s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:30 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:23:30 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Deleted volume successfully. Jul 23 22:23:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d441a648-38fd-4c44-8ee9-ea6e3baf7854 tempest-VolumesTestJSON-502685364 None] Lock "cinder-e4301187-45f8-4147-b87b-1fbe8d13df19-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:23:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-d36648eb-2abd-4ac9-9ddd-6e79187632a7 req-c0fc6a43-a654-4695-a9f2-a8386ac8c62e tempest-ServerActionsTestOtherA-1328799028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-d36648eb-2abd-4ac9-9ddd-6e79187632a7 req-c0fc6a43-a654-4695-a9f2-a8386ac8c62e tempest-ServerActionsTestOtherA-1328799028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:31 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[412541c0-0293-458c-98e8-d38c330a8edb]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:23:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-d36648eb-2abd-4ac9-9ddd-6e79187632a7 req-c0fc6a43-a654-4695-a9f2-a8386ac8c62e tempest-ServerActionsTestOtherA-1328799028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:31 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453 Jul 23 22:23:31 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:32 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-d36648eb-2abd-4ac9-9ddd-6e79187632a7 req-c0fc6a43-a654-4695-a9f2-a8386ac8c62e tempest-ServerActionsTestOtherA-1328799028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453" returned: 0 in 0.878s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-d36648eb-2abd-4ac9-9ddd-6e79187632a7 req-c0fc6a43-a654-4695-a9f2-a8386ac8c62e tempest-ServerActionsTestOtherA-1328799028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.908s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-d36648eb-2abd-4ac9-9ddd-6e79187632a7 req-c0fc6a43-a654-4695-a9f2-a8386ac8c62e tempest-ServerActionsTestOtherA-1328799028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '046b370c-4569-48c9-8009-bd597702eae6', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:23:32 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-d36648eb-2abd-4ac9-9ddd-6e79187632a7 req-c0fc6a43-a654-4695-a9f2-a8386ac8c62e tempest-ServerActionsTestOtherA-1328799028 None] attachment_update completed successfully. Jul 23 22:23:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-27263262-0454-4ad9-b560-45f32e6e9f38 req-c88b4527-a885-4b0f-aaba-5e53943f3091 tempest-AttachVolumeShelveTestJSON-1177938564 None] No connector for attachment 237e5a88-1d66-4e73-9027-5088d1c088fb; skipping storage backend terminate_connection call. {{(pid=88308) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 23 22:23:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-27263262-0454-4ad9-b560-45f32e6e9f38 req-c88b4527-a885-4b0f-aaba-5e53943f3091 tempest-AttachVolumeShelveTestJSON-1177938564 None] Deleting attachment 237e5a88-1d66-4e73-9027-5088d1c088fb. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:23:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-71caa524-38df-44e8-91ef-a4086851e284 tempest-BackendsCapabilitiesAdminTestsJSON-1594250616 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7198677062988, 'free_capacity_gb': 1775.7198677062988, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88308) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 23 22:23:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e1f71090-c3f2-4f48-ab8a-bd7a83a1494f tempest-BackendsCapabilitiesAdminTestsJSON-1594250616 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7198677062988, 'free_capacity_gb': 1775.7198677062988, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88308) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 23 22:23:37 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-4d5f8f8b-e538-4587-a423-fedf6283273c req-4237c103-6a3b-4bc1-87b7-e986170a2f3a tempest-ServerActionsTestOtherA-1328799028 None] Terminate volume connection completed successfully. Jul 23 22:23:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-4d5f8f8b-e538-4587-a423-fedf6283273c req-4237c103-6a3b-4bc1-87b7-e986170a2f3a tempest-ServerActionsTestOtherA-1328799028 None] Deleting attachment 046b370c-4569-48c9-8009-bd597702eae6. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:23:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-4d5f8f8b-e538-4587-a423-fedf6283273c req-b42e1f0b-4826-4989-8668-d13986b31250 tempest-ServerActionsTestOtherA-1328799028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-4d5f8f8b-e538-4587-a423-fedf6283273c req-b42e1f0b-4826-4989-8668-d13986b31250 tempest-ServerActionsTestOtherA-1328799028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:39 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[09639feb-efc4-46f7-908a-b11a1c76be8c]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:23:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-4d5f8f8b-e538-4587-a423-fedf6283273c req-b42e1f0b-4826-4989-8668-d13986b31250 tempest-ServerActionsTestOtherA-1328799028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:39 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453 Jul 23 22:23:39 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:40 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-4d5f8f8b-e538-4587-a423-fedf6283273c req-b42e1f0b-4826-4989-8668-d13986b31250 tempest-ServerActionsTestOtherA-1328799028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453" returned: 0 in 0.738s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-4d5f8f8b-e538-4587-a423-fedf6283273c req-b42e1f0b-4826-4989-8668-d13986b31250 tempest-ServerActionsTestOtherA-1328799028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.769s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-4d5f8f8b-e538-4587-a423-fedf6283273c req-b42e1f0b-4826-4989-8668-d13986b31250 tempest-ServerActionsTestOtherA-1328799028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fe5acf2-3a43-4ea7-8f08-bfd8f26bf096', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:23:40 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-4d5f8f8b-e538-4587-a423-fedf6283273c req-b42e1f0b-4826-4989-8668-d13986b31250 tempest-ServerActionsTestOtherA-1328799028 None] attachment_update completed successfully. Jul 23 22:23:50 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:UPDATE=41,cinder:SELECT=45,cinder:DELETE=6,cinder:INSERT=7 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:23:50 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=43,cinder:UPDATE=59,cinder:INSERT=14,cinder:DELETE=3 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Flow 'volume_create_manager' (bcf3f4c2-40a2-4f03-b026-e07764a33bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea13b70-ed90-49bc-8fc1-758a9f86c9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea13b70-ed90-49bc-8fc1-758a9f86c9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-927764242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45c93bbc7ee4467792a9e8637375bf2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:23:56Z,use_quota=True,user_id='8f04815d140a457fb16a201e4d61f690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a685268f-819c-4db1-8064-d8a509b01878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a685268f-819c-4db1-8064-d8a509b01878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f06399-abfb-491f-aac8-601748bef60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f06399-abfb-491f-aac8-601748bef60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f', 'volume_name': 'volume-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924d259a-3a1a-456d-8229-fbda586a1436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924d259a-3a1a-456d-8229-fbda586a1436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e59d0db-bb97-4ffe-a2b2-17383a63b0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:56 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Volume c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f', 'volume_size': 1} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-927764242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45c93bbc7ee4467792a9e8637375bf2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:23:56Z,use_quota=True,user_id='8f04815d140a457fb16a201e4d61f690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Creating volume c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:23:56 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:23:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:56 devstack sudo[94678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f 1073741824 Jul 23 22:23:56 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:57 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f 1073741824" returned: 0 in 0.659s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:57 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f Jul 23 22:23:57 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:57 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f" returned: 0 in 0.263s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:23:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:23:57 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e59d0db-bb97-4ffe-a2b2-17383a63b0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:57 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07772e58-be7e-4abe-98bf-9ec7e724511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:23:57 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Volume volume-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f (c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f): created successfully Jul 23 22:23:57 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07772e58-be7e-4abe-98bf-9ec7e724511e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:23:57 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Flow 'volume_create_manager' (bcf3f4c2-40a2-4f03-b026-e07764a33bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:23:57 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-74eb0aac-dd9d-4a3a-a1f7-3675802fc789 tempest-VolumesServicesTestJSON-391716603 None] Created volume successfully. Jul 23 22:23:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Acquiring lock "cinder-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:23:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Lock "cinder-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:23:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Acquiring lock "cinder-quobyte-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:23:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Lock "cinder-quobyte-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f" acquired by "delete_volume" :: waited 0.045s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:23:59 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33e6034-2d21-46f7-9a94-cc5c609d19f5]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:23:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:59 devstack sudo[94690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f Jul 23 22:23:59 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:23:59 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root Jul 23 22:23:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f" returned: 0 in 0.644s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:23:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:23:59 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f Jul 23 22:23:59 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:00 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f" returned: 0 in 0.448s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Lock "cinder-quobyte-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f" released by "delete_volume" :: held 1.142s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:24:00 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Created reservations ['fc4a0d90-4c87-4b04-a4a7-7f4a249dfc89', '1e321523-b4f7-48ff-aebb-982510f140f5', '2ce47c2b-1f4a-49d2-be38-5313727e56b7', '509ac460-5634-4149-b7de-1cdf61f3a951'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:24:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:24:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:24:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:00 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:24:00 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:00 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.449s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:00 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:24:00 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Deleted volume successfully. Jul 23 22:24:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-079a166b-880f-4ea2-8744-6894f45bd537 tempest-VolumesServicesTestJSON-391716603 None] Lock "cinder-c39b6f87-6c9c-46a4-ae5c-ee5525ea9d6f-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Flow 'volume_create_manager' (987c5079-c161-4cab-9fae-b7e4de3f07d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9016dd0f-c7cc-4968-b3fb-91a3180c220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9016dd0f-c7cc-4968-b3fb-91a3180c220e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-603357472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=229d7555-acb7-4642-9b40-1ef4fb0eb7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5446a0323d76451497979262a8fd66fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:24:10Z,use_quota=True,user_id='5f43383ff05a48e0be07c64faddd21ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(999dcbc5-8bb7-4311-a7d8-94bf00f09b3e),volume_type_id=999dcbc5-8bb7-4311-a7d8-94bf00f09b3e)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7850cd1a-bf8f-4670-9d8f-b36c4343498a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7850cd1a-bf8f-4670-9d8f-b36c4343498a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a60fb8-704e-4840-ba07-0da05563f81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a60fb8-704e-4840-ba07-0da05563f81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '229d7555-acb7-4642-9b40-1ef4fb0eb7d2', 'volume_name': 'volume-229d7555-acb7-4642-9b40-1ef4fb0eb7d2', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd947ee-4c87-412c-9735-321880b55786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd947ee-4c87-412c-9735-321880b55786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5092ba6c-74d2-4734-86de-c0d06133271f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:10 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Volume 229d7555-acb7-4642-9b40-1ef4fb0eb7d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-229d7555-acb7-4642-9b40-1ef4fb0eb7d2', 'volume_size': 1} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-603357472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=229d7555-acb7-4642-9b40-1ef4fb0eb7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5446a0323d76451497979262a8fd66fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:24:10Z,use_quota=True,user_id='5f43383ff05a48e0be07c64faddd21ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(999dcbc5-8bb7-4311-a7d8-94bf00f09b3e),volume_type_id=999dcbc5-8bb7-4311-a7d8-94bf00f09b3e)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Creating volume 229d7555-acb7-4642-9b40-1ef4fb0eb7d2 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:24:10 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-229d7555-acb7-4642-9b40-1ef4fb0eb7d2 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:10 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-229d7555-acb7-4642-9b40-1ef4fb0eb7d2 1073741824 Jul 23 22:24:10 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:10 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-229d7555-acb7-4642-9b40-1ef4fb0eb7d2 1073741824" returned: 0 in 0.529s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-229d7555-acb7-4642-9b40-1ef4fb0eb7d2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:10 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-229d7555-acb7-4642-9b40-1ef4fb0eb7d2 Jul 23 22:24:10 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:10 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-229d7555-acb7-4642-9b40-1ef4fb0eb7d2" returned: 0 in 0.287s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5092ba6c-74d2-4734-86de-c0d06133271f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-229d7555-acb7-4642-9b40-1ef4fb0eb7d2', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edddc358-d7d3-49c6-ae10-1132bcac07c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:10 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Volume volume-229d7555-acb7-4642-9b40-1ef4fb0eb7d2 (229d7555-acb7-4642-9b40-1ef4fb0eb7d2): created successfully Jul 23 22:24:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edddc358-d7d3-49c6-ae10-1132bcac07c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Flow 'volume_create_manager' (987c5079-c161-4cab-9fae-b7e4de3f07d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:24:11 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-98097803-0a62-4954-81bc-90e685905c9f tempest-VolumeTypesAccessTest-123521132 None] Created volume successfully. Jul 23 22:24:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Acquiring lock "cinder-229d7555-acb7-4642-9b40-1ef4fb0eb7d2-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:24:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Lock "cinder-229d7555-acb7-4642-9b40-1ef4fb0eb7d2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:24:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Acquiring lock "cinder-quobyte-229d7555-acb7-4642-9b40-1ef4fb0eb7d2" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:24:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Lock "cinder-quobyte-229d7555-acb7-4642-9b40-1ef4fb0eb7d2" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:24:12 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cc396d-9900-4e76-ab2d-cc485989e53a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:24:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-229d7555-acb7-4642-9b40-1ef4fb0eb7d2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:12 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-229d7555-acb7-4642-9b40-1ef4fb0eb7d2 Jul 23 22:24:12 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:12 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-229d7555-acb7-4642-9b40-1ef4fb0eb7d2" returned: 0 in 0.430s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-229d7555-acb7-4642-9b40-1ef4fb0eb7d2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:12 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-229d7555-acb7-4642-9b40-1ef4fb0eb7d2 Jul 23 22:24:12 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:12 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-229d7555-acb7-4642-9b40-1ef4fb0eb7d2" returned: 0 in 0.294s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Lock "cinder-quobyte-229d7555-acb7-4642-9b40-1ef4fb0eb7d2" released by "delete_volume" :: held 0.792s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:24:13 devstack cinder-volume[88308]: WARNING cinder.quota [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-83408623 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-83408623, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:24:13 devstack cinder-volume[88308]: WARNING cinder.quota [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-83408623 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-83408623, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:24:13 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Created reservations ['42461c63-d36e-4e42-8a7d-d2bea2805e3a', '447c944a-9625-411b-9cda-1ab17b701643', '18306b34-7638-4d56-bfad-fd64bab90cda', '662d424e-8573-44b4-92c6-e47876e60bf5'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:24:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:24:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:24:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:13 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:24:13 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:13 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.455s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:13 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:24:13 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Deleted volume successfully. Jul 23 22:24:13 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-078d3005-384e-4279-84e7-a5654d5d6c67 tempest-VolumeTypesAccessTest-123521132 None] Lock "cinder-229d7555-acb7-4642-9b40-1ef4fb0eb7d2-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:24:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Acquiring lock "cinder-eed53169-ce47-4a05-a604-cd5c7c6cd35c-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:24:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Lock "cinder-eed53169-ce47-4a05-a604-cd5c7c6cd35c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:24:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Acquiring lock "cinder-quobyte-eed53169-ce47-4a05-a604-cd5c7c6cd35c" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:24:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Lock "cinder-quobyte-eed53169-ce47-4a05-a604-cd5c7c6cd35c" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:24:20 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3633cb34-9fb4-4440-bafc-960a3bfa5b48]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:24:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eed53169-ce47-4a05-a604-cd5c7c6cd35c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:20 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eed53169-ce47-4a05-a604-cd5c7c6cd35c Jul 23 22:24:20 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:20 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eed53169-ce47-4a05-a604-cd5c7c6cd35c" returned: 0 in 0.366s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eed53169-ce47-4a05-a604-cd5c7c6cd35c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:20 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eed53169-ce47-4a05-a604-cd5c7c6cd35c Jul 23 22:24:20 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:20 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eed53169-ce47-4a05-a604-cd5c7c6cd35c" returned: 0 in 0.265s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:20 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Lock "cinder-quobyte-eed53169-ce47-4a05-a604-cd5c7c6cd35c" released by "delete_volume" :: held 0.689s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:24:20 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Created reservations ['e0cab71b-d10f-490e-b2af-9700c156ebd8', 'b78d194d-9250-43e1-8c0a-96918f53c241', 'ee5ea3d9-db40-49cf-aace-34ce1fadc982', '601b6771-29a4-4129-9f1c-c68ea683d35b'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:24:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:24:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:24:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:20 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:24:20 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:21 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.266s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:21 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:24:21 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Deleted volume successfully. Jul 23 22:24:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8e4c4fd3-1d47-4a41-a863-37780a9e7f2a tempest-AttachVolumeShelveTestJSON-1177938564 None] Lock "cinder-eed53169-ce47-4a05-a604-cd5c7c6cd35c-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:24:24 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-ee86f87c-9c11-4041-927a-a1517efcfdb0 req-e0fd449a-e94d-426f-ba74-aaffec8ecc54 tempest-ServerActionsTestOtherA-1328799028 None] Terminate volume connection completed successfully. Jul 23 22:24:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-ee86f87c-9c11-4041-927a-a1517efcfdb0 req-e0fd449a-e94d-426f-ba74-aaffec8ecc54 tempest-ServerActionsTestOtherA-1328799028 None] Deleting attachment 1fe5acf2-3a43-4ea7-8f08-bfd8f26bf096. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:24:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:24:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:24:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:24:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:26 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:24:26 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:26 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.393s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:24:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:24:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 8 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:24:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:24:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Acquiring lock "cinder-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:24:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Lock "cinder-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:24:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Acquiring lock "cinder-quobyte-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Lock "cinder-quobyte-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453" acquired by "delete_volume" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b8d096-54a7-4afb-ab5b-df06ee74b59f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Flow 'volume_create_manager' (9bb4d0ae-acd2-45de-9f74-eecdbe1ed54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4e1774-41c2-46d1-af45-6cb65acb6ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4e1774-41c2-46d1-af45-6cb65acb6ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-338384872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d230ee2a-fff1-4b36-8daf-cf0be8aca744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a428de52144616866c19401729898b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:24:30Z,use_quota=True,user_id='5fae1a2094b341b5963a9c3279fb9864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21ce4c8-cd42-4750-8eac-74c9727e5de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21ce4c8-cd42-4750-8eac-74c9727e5de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93420c0-6240-4f45-aafe-6f3d9058985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93420c0-6240-4f45-aafe-6f3d9058985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd230ee2a-fff1-4b36-8daf-cf0be8aca744', 'volume_name': 'volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:30 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453 Jul 23 22:24:30 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42f4045-c73c-4246-b706-d789d59584f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42f4045-c73c-4246-b706-d789d59584f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efa4205-3226-4984-a586-28d4f8c50198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:30 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Volume d230ee2a-fff1-4b36-8daf-cf0be8aca744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744', 'volume_size': 1} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-338384872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d230ee2a-fff1-4b36-8daf-cf0be8aca744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a428de52144616866c19401729898b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:24:30Z,use_quota=True,user_id='5fae1a2094b341b5963a9c3279fb9864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Creating volume d230ee2a-fff1-4b36-8daf-cf0be8aca744 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:24:30 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:30 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 1073741824 Jul 23 22:24:30 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:30 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453" returned: 0 in 0.558s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:30 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453 Jul 23 22:24:30 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:30 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 1073741824" returned: 0 in 0.522s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:30 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 Jul 23 22:24:30 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:30 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453" returned: 0 in 0.343s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Lock "cinder-quobyte-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453" released by "delete_volume" :: held 0.981s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Created reservations ['25b13422-d69c-4d96-9b10-b4de7fa49e77', 'de7fdab5-2922-4cb6-ba17-17ab9acc7be6', 'e5fc46c9-cf42-4c48-afee-8758e5d6b74b', '5e523531-ac7a-4667-83d3-0123fd07ca9e'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:31 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:24:31 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:31 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744" returned: 0 in 0.375s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efa4205-3226-4984-a586-28d4f8c50198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5e411c-d8e8-4598-b21d-64f3e9e1fa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:31 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Volume volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 (d230ee2a-fff1-4b36-8daf-cf0be8aca744): created successfully Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5e411c-d8e8-4598-b21d-64f3e9e1fa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Flow 'volume_create_manager' (9bb4d0ae-acd2-45de-9f74-eecdbe1ed54b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:24:31 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-7e551c2c-d868-4470-acbd-c9f614c5882a req-75dc5af9-857f-4fc6-85ee-ca6442498ad8 tempest-VolumesSnapshotsTestJSON-1619395423 None] Created volume successfully. Jul 23 22:24:31 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.327s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:24:31 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Deleted volume successfully. Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5ec64f78-7092-4ff8-9628-a8512b7c7853 tempest-ServerActionsTestOtherA-1328799028 None] Lock "cinder-a6ba0ff2-dfc4-4e88-85e6-9c4c2ecd3453-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] Creating offline snapshot 3bf8c20d-3435-49c5-945a-9272061653c9 of volume d230ee2a-fff1-4b36-8daf-cf0be8aca744 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cf7b44-44a0-4e19-b86f-78f8f91f3be2]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:24:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:32 devstack sudo[95096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 Jul 23 22:24:32 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:32 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744" returned: 0 in 0.545s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:32 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9 1G Jul 23 22:24:32 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:32 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9 1G" returned: 0 in 0.458s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:32 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9 Jul 23 22:24:32 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:33 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9" returned: 0 in 0.403s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:33 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9 is being set with open permissions: ugo+rw Jul 23 22:24:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:33 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9 Jul 23 22:24:33 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:33 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9" returned: 0 in 0.291s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:33 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.info Jul 23 22:24:33 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:33 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.info" returned: 0 in 0.325s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:33 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.info is being set with open permissions: ugo+rw Jul 23 22:24:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:33 devstack sudo[95149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.info Jul 23 22:24:33 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:34 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.info" returned: 0 in 0.623s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:34 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-3f2fdaeb-aba4-46de-ae44-fe36719607d4 req-18148c5a-bdd7-4bb9-bd78-b59b327fca91 tempest-VolumesSnapshotsTestJSON-1619395423 None] Create snapshot completed successfully Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Flow 'volume_create_manager' (ca95d186-5e32-44c9-9e87-ebea87b2e776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fa3ec3-f80c-4466-aafd-f57f9d27f5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fa3ec3-f80c-4466-aafd-f57f9d27f5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-693484273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dcd0d71-1a1a-4566-80cc-a08d6a834f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceeba8eddb841cc9495499210c4d9c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:24:35Z,use_quota=True,user_id='b0be5df9a44c4a8fafb1657b501c25fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ad57f0-dacb-41d5-b89e-06041bd791c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ad57f0-dacb-41d5-b89e-06041bd791c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973e198f-b515-4d1d-bb3e-176cee8115a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973e198f-b515-4d1d-bb3e-176cee8115a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dcd0d71-1a1a-4566-80cc-a08d6a834f93', 'volume_name': 'volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9e3a62-1c4a-4315-83ba-419c1cf06263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9e3a62-1c4a-4315-83ba-419c1cf06263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ad883a-6caa-487b-b14c-c69870899b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:34 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Volume 7dcd0d71-1a1a-4566-80cc-a08d6a834f93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93', 'volume_size': 1} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-693484273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dcd0d71-1a1a-4566-80cc-a08d6a834f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceeba8eddb841cc9495499210c4d9c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:24:35Z,use_quota=True,user_id='b0be5df9a44c4a8fafb1657b501c25fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Creating volume 7dcd0d71-1a1a-4566-80cc-a08d6a834f93 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:24:34 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:24:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:34 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93 1073741824 Jul 23 22:24:34 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Acquiring lock "cinder-3bf8c20d-3435-49c5-945a-9272061653c9-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "cinder-3bf8c20d-3435-49c5-945a-9272061653c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Acquiring lock "cinder-quobyte-d230ee2a-fff1-4b36-8daf-cf0be8aca744" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "cinder-quobyte-d230ee2a-fff1-4b36-8daf-cf0be8aca744" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Acquiring lock "cinder-quobyte-3bf8c20d-3435-49c5-945a-9272061653c9" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:24:35 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93 1073741824" returned: 0 in 0.563s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "cinder-quobyte-3bf8c20d-3435-49c5-945a-9272061653c9" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Deleting offline snapshot 3bf8c20d-3435-49c5-945a-9272061653c9 of volume d230ee2a-fff1-4b36-8daf-cf0be8aca744 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] snapshot_file for this snap is: volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[895d89d8-dfc7-4283-aad3-68edbc237645]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:35 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93 Jul 23 22:24:35 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:35 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9 Jul 23 22:24:35 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:35 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93" returned: 0 in 0.343s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ad883a-6caa-487b-b14c-c69870899b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d55f4d-1ed1-4e85-a6e5-8ad2ad3626da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:35 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Volume volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93 (7dcd0d71-1a1a-4566-80cc-a08d6a834f93): created successfully Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d55f4d-1ed1-4e85-a6e5-8ad2ad3626da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Flow 'volume_create_manager' (ca95d186-5e32-44c9-9e87-ebea87b2e776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:24:36 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a8fd28a1-7fd9-494f-b134-3bdf282e6fc0 tempest-AttachVolumeTestJSON-111733113 None] Created volume successfully. Jul 23 22:24:36 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9" returned: 0 in 0.481s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:24:36 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da9ba46-1692-4acd-b83a-07037a07a018]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:24:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:36 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 Jul 23 22:24:36 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:36 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744" returned: 0 in 0.408s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:36 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9 Jul 23 22:24:36 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:36 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9" returned: 0 in 0.424s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:36 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9 Jul 23 22:24:36 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:37 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744.3bf8c20d-3435-49c5-945a-9272061653c9" returned: 0 in 0.347s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "cinder-quobyte-3bf8c20d-3435-49c5-945a-9272061653c9" released by "_delete_snapshot" :: held 1.828s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:24:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "cinder-quobyte-d230ee2a-fff1-4b36-8daf-cf0be8aca744" released by "delete_snapshot" :: held 1.882s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:24:37 devstack cinder-volume[88308]: WARNING cinder.quota [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:24:37 devstack cinder-volume[88308]: DEBUG cinder.quota [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Created reservations ['7bf62549-1703-4510-8a4f-6f13d7b0baa5', 'b77dea2e-d156-4005-9a05-7e00b8d5262b', '41fc40f5-165f-4c15-a139-0c9e28f0148f', '8e605126-01cb-45a0-b4cb-734416ee1f35'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:24:37 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Delete snapshot completed successfully. Jul 23 22:24:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-d016bfac-29f4-49f1-9826-bb85c089a5b5 req-f341dee8-9e55-4baa-892f-5a59c6675014 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "cinder-3bf8c20d-3435-49c5-945a-9272061653c9-delete_snapshot" released by "delete_snapshot" :: held 2.106s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:24:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Acquiring lock "cinder-d230ee2a-fff1-4b36-8daf-cf0be8aca744-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:24:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "cinder-d230ee2a-fff1-4b36-8daf-cf0be8aca744-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:24:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Acquiring lock "cinder-quobyte-d230ee2a-fff1-4b36-8daf-cf0be8aca744" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:24:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "cinder-quobyte-d230ee2a-fff1-4b36-8daf-cf0be8aca744" acquired by "delete_volume" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:24:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-8370c0b2-3728-4b9e-bde6-58995609dc0c req-37ec198b-382c-40cf-8328-4f37716f91a4 tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-8370c0b2-3728-4b9e-bde6-58995609dc0c req-37ec198b-382c-40cf-8328-4f37716f91a4 tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:38 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe2f10b-770b-4963-b551-8e404abf3eca]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:24:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:38 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f6074e-7ad6-4818-a50c-0a274600e42f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:24:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-8370c0b2-3728-4b9e-bde6-58995609dc0c req-37ec198b-382c-40cf-8328-4f37716f91a4 tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:38 devstack sudo[95197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 Jul 23 22:24:38 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:38 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93 Jul 23 22:24:38 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:38 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744" returned: 0 in 0.485s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:38 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744 Jul 23 22:24:38 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:38 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-8370c0b2-3728-4b9e-bde6-58995609dc0c req-37ec198b-382c-40cf-8328-4f37716f91a4 tempest-AttachVolumeTestJSON-111733113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93" returned: 0 in 0.523s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-8370c0b2-3728-4b9e-bde6-58995609dc0c req-37ec198b-382c-40cf-8328-4f37716f91a4 tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.562s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-8370c0b2-3728-4b9e-bde6-58995609dc0c req-37ec198b-382c-40cf-8328-4f37716f91a4 tempest-AttachVolumeTestJSON-111733113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'feb29fed-4cde-43ee-8f9e-279cc50623d1', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:24:38 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-8370c0b2-3728-4b9e-bde6-58995609dc0c req-37ec198b-382c-40cf-8328-4f37716f91a4 tempest-AttachVolumeTestJSON-111733113 None] attachment_update completed successfully. Jul 23 22:24:38 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d230ee2a-fff1-4b36-8daf-cf0be8aca744" returned: 0 in 0.417s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "cinder-quobyte-d230ee2a-fff1-4b36-8daf-cf0be8aca744" released by "delete_volume" :: held 0.993s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:24:39 devstack cinder-volume[88308]: DEBUG cinder.quota [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Created reservations ['85c30499-8ebf-4215-b255-f0f2cd03b6e1', 'ae0b1d30-ab0a-4fc4-84ce-6de0add5f824', '90192094-e137-4233-ba30-9423acfa697e', '32ca3f39-6135-4d43-bf58-f7ebba73da9d'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:24:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:24:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:24:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:39 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:24:39 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:39 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.281s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:39 devstack cinder-volume[88308]: DEBUG cinder.manager [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:24:39 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Deleted volume successfully. Jul 23 22:24:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-7d720e2d-287e-4fe3-a68a-c728b4c31b1b req-cc58dc29-b866-4df0-8ad3-29421d8796d2 tempest-VolumesSnapshotsTestJSON-1619395423 None] Lock "cinder-d230ee2a-fff1-4b36-8daf-cf0be8aca744-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Flow 'volume_create_manager' (86cf6739-1498-496d-b812-207d6325dee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2f3fa3-07cb-4bd9-bb6d-e0bd98d8aa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2f3fa3-07cb-4bd9-bb6d-e0bd98d8aa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-722954683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bda607-be4c-4266-a8c9-5ece42c153fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceeba8eddb841cc9495499210c4d9c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:24:42Z,use_quota=True,user_id='b0be5df9a44c4a8fafb1657b501c25fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8b80c0-b59b-4036-8ef0-5384147f9a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8b80c0-b59b-4036-8ef0-5384147f9a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a425898-1b7b-4cdf-817d-1ab6b00bdf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a425898-1b7b-4cdf-817d-1ab6b00bdf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59bda607-be4c-4266-a8c9-5ece42c153fa', 'volume_name': 'volume-59bda607-be4c-4266-a8c9-5ece42c153fa', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f37e347-2f12-4dc5-83a6-23fd1354f4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f37e347-2f12-4dc5-83a6-23fd1354f4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db97ca2e-6604-4c05-b1de-da20a01e9aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:42 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Volume 59bda607-be4c-4266-a8c9-5ece42c153fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59bda607-be4c-4266-a8c9-5ece42c153fa', 'volume_size': 1} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-722954683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bda607-be4c-4266-a8c9-5ece42c153fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceeba8eddb841cc9495499210c4d9c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:24:42Z,use_quota=True,user_id='b0be5df9a44c4a8fafb1657b501c25fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Creating volume 59bda607-be4c-4266-a8c9-5ece42c153fa {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:24:42 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-59bda607-be4c-4266-a8c9-5ece42c153fa 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:42 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-59bda607-be4c-4266-a8c9-5ece42c153fa 1073741824 Jul 23 22:24:42 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:42 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-59bda607-be4c-4266-a8c9-5ece42c153fa 1073741824" returned: 0 in 0.630s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-59bda607-be4c-4266-a8c9-5ece42c153fa {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:42 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-59bda607-be4c-4266-a8c9-5ece42c153fa Jul 23 22:24:42 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:43 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-59bda607-be4c-4266-a8c9-5ece42c153fa" returned: 0 in 0.402s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:24:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db97ca2e-6604-4c05-b1de-da20a01e9aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59bda607-be4c-4266-a8c9-5ece42c153fa', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6c714f-492d-4f4a-95f8-0ab74531c5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:43 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Volume volume-59bda607-be4c-4266-a8c9-5ece42c153fa (59bda607-be4c-4266-a8c9-5ece42c153fa): created successfully Jul 23 22:24:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6c714f-492d-4f4a-95f8-0ab74531c5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Flow 'volume_create_manager' (86cf6739-1498-496d-b812-207d6325dee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:24:43 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4bb6a25e-d382-4a14-82b1-2f919e7aeb92 tempest-AttachVolumeTestJSON-111733113 None] Created volume successfully. Jul 23 22:24:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-b65b818b-43ff-4a5e-ad42-dcce42cc9229 req-6c6bf3b9-4252-45b4-a61e-dc69b854b9b7 tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-b65b818b-43ff-4a5e-ad42-dcce42cc9229 req-6c6bf3b9-4252-45b4-a61e-dc69b854b9b7 tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:45 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[32047734-ab1e-4436-9dc2-83b4123f9942]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:24:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-b65b818b-43ff-4a5e-ad42-dcce42cc9229 req-6c6bf3b9-4252-45b4-a61e-dc69b854b9b7 tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-59bda607-be4c-4266-a8c9-5ece42c153fa {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:45 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-59bda607-be4c-4266-a8c9-5ece42c153fa Jul 23 22:24:45 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:45 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-b65b818b-43ff-4a5e-ad42-dcce42cc9229 req-6c6bf3b9-4252-45b4-a61e-dc69b854b9b7 tempest-AttachVolumeTestJSON-111733113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-59bda607-be4c-4266-a8c9-5ece42c153fa" returned: 0 in 0.479s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-b65b818b-43ff-4a5e-ad42-dcce42cc9229 req-6c6bf3b9-4252-45b4-a61e-dc69b854b9b7 tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.507s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-b65b818b-43ff-4a5e-ad42-dcce42cc9229 req-6c6bf3b9-4252-45b4-a61e-dc69b854b9b7 tempest-AttachVolumeTestJSON-111733113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-59bda607-be4c-4266-a8c9-5ece42c153fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29d1592c-d9bb-4702-a5aa-ba6894c8e988', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:24:45 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-b65b818b-43ff-4a5e-ad42-dcce42cc9229 req-6c6bf3b9-4252-45b4-a61e-dc69b854b9b7 tempest-AttachVolumeTestJSON-111733113 None] attachment_update completed successfully. Jul 23 22:24:48 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-79a45d7c-44af-4be6-bc52-33372e3fa7f4 tempest-GroupSnapshotsTest-1247013327 None] Group tempest-GroupSnapshotsTest-Group-235097026: creating Jul 23 22:24:48 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-79a45d7c-44af-4be6-bc52-33372e3fa7f4 tempest-GroupSnapshotsTest-1247013327 None] Group tempest-GroupSnapshotsTest-Group-235097026: created successfully Jul 23 22:24:48 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-79a45d7c-44af-4be6-bc52-33372e3fa7f4 tempest-GroupSnapshotsTest-1247013327 None] Create group completed successfully. Jul 23 22:24:48 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-07f3a17f-9d47-4053-a058-d1fc5e643d0e req-1ae98955-ee64-4aa3-9d99-ee994cb03f86 tempest-AttachVolumeTestJSON-111733113 None] Terminate volume connection completed successfully. Jul 23 22:24:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-07f3a17f-9d47-4053-a058-d1fc5e643d0e req-1ae98955-ee64-4aa3-9d99-ee994cb03f86 tempest-AttachVolumeTestJSON-111733113 None] Deleting attachment feb29fed-4cde-43ee-8f9e-279cc50623d1. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:24:50 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-b78385fc-9a65-4ba4-b6be-0bb54b7d12b4 req-da6555b0-2c5d-4b88-a5d4-9636732c9ca2 tempest-AttachVolumeTestJSON-111733113 None] Terminate volume connection completed successfully. Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-b78385fc-9a65-4ba4-b6be-0bb54b7d12b4 req-da6555b0-2c5d-4b88-a5d4-9636732c9ca2 tempest-AttachVolumeTestJSON-111733113 None] Deleting attachment 29d1592c-d9bb-4702-a5aa-ba6894c8e988. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=54,cinder:INSERT=18,cinder:UPDATE=68,cinder:DELETE=7 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=66,cinder:UPDATE=65,cinder:DELETE=4,cinder:INSERT=12 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Flow 'volume_create_manager' (c0fbeba2-2a26-49fc-9404-c60996a0c5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8133ae8-1be9-4166-a871-fa5e4f19a435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8133ae8-1be9-4166-a871-fa5e4f19a435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1299274728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6db80cb3-fc2a-45b1-9497-4a2cc8ea3148,host='devstack@QuobyteHD#QuobyteHD',id=37757887-e2fc-430b-86d0-1203f4ffa3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7893fc2bfdf74a1189a29ea49fffe54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:24:50Z,use_quota=True,user_id='6b6b0471606d4d8cbd4ffff133c42b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a32abfe-7390-4955-90e3-f5f783da1fcb),volume_type_id=1a32abfe-7390-4955-90e3-f5f783da1fcb)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783040e3-2d5a-4aed-b47f-c400446bfc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783040e3-2d5a-4aed-b47f-c400446bfc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17bf2767-263a-4674-9069-4d7108537038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17bf2767-263a-4674-9069-4d7108537038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37757887-e2fc-430b-86d0-1203f4ffa3ef', 'volume_name': 'volume-37757887-e2fc-430b-86d0-1203f4ffa3ef', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3aca9e2-10d7-4578-96ed-f70996062d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3aca9e2-10d7-4578-96ed-f70996062d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb3c6fc-015a-47e7-a975-b8d16942a3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:50 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Volume 37757887-e2fc-430b-86d0-1203f4ffa3ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37757887-e2fc-430b-86d0-1203f4ffa3ef', 'volume_size': 1} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6db80cb3-fc2a-45b1-9497-4a2cc8ea3148,created_at=2026-07-23T20:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1299274728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6db80cb3-fc2a-45b1-9497-4a2cc8ea3148,host='devstack@QuobyteHD#QuobyteHD',id=37757887-e2fc-430b-86d0-1203f4ffa3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7893fc2bfdf74a1189a29ea49fffe54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:24:50Z,use_quota=True,user_id='6b6b0471606d4d8cbd4ffff133c42b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a32abfe-7390-4955-90e3-f5f783da1fcb),volume_type_id=1a32abfe-7390-4955-90e3-f5f783da1fcb)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Creating volume 37757887-e2fc-430b-86d0-1203f4ffa3ef {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:24:50 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:24:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:50 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef 1073741824 Jul 23 22:24:50 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:51 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef 1073741824" returned: 0 in 0.641s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:51 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef Jul 23 22:24:51 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:51 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef" returned: 0 in 0.389s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:51 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:24:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb3c6fc-015a-47e7-a975-b8d16942a3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37757887-e2fc-430b-86d0-1203f4ffa3ef', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4628d2-fe68-4967-8d88-e1a9e7e0a884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:51 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Volume volume-37757887-e2fc-430b-86d0-1203f4ffa3ef (37757887-e2fc-430b-86d0-1203f4ffa3ef): created successfully Jul 23 22:24:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4628d2-fe68-4967-8d88-e1a9e7e0a884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Flow 'volume_create_manager' (c0fbeba2-2a26-49fc-9404-c60996a0c5a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:24:51 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-75b582be-f952-47b5-8ac3-9dacfb14c593 tempest-GroupSnapshotsTest-1247013327 None] Created volume successfully. Jul 23 22:24:52 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e6aca26b-4991-45b1-a162-2ca9484dad80 tempest-GroupSnapshotsV319Test-123895909 None] Group tempest-GroupSnapshotsV319Test-Group-1575177520: creating Jul 23 22:24:52 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e6aca26b-4991-45b1-a162-2ca9484dad80 tempest-GroupSnapshotsV319Test-123895909 None] Group tempest-GroupSnapshotsV319Test-Group-1575177520: created successfully Jul 23 22:24:52 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e6aca26b-4991-45b1-a162-2ca9484dad80 tempest-GroupSnapshotsV319Test-123895909 None] Create group completed successfully. Jul 23 22:24:53 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] GroupSnapshot de4b8c0d-c074-49ad-9a2a-c025e8454bb7: creating. Jul 23 22:24:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] Group snapshot de4b8c0d-c074-49ad-9a2a-c025e8454bb7: creating. {{(pid=88308) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 22:24:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] Creating offline snapshot fff82af4-71f8-4a63-9d6b-a481876e3ce6 of volume 37757887-e2fc-430b-86d0-1203f4ffa3ef {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:24:53 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[83063765-df1c-44d0-b8fa-b3b7a354959d]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:24:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:53 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef Jul 23 22:24:53 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:53 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef" returned: 0 in 0.477s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:53 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 1G Jul 23 22:24:53 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:54 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:24:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Flow 'volume_create_manager' (68468d63-bb21-492b-bb89-37dbddaf188b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:24:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7f3c21-b936-432e-b543-ad0e862826a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7f3c21-b936-432e-b543-ad0e862826a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1523089277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=75d98086-3b0b-4714-97fb-158786380d23,host='devstack@QuobyteHD#QuobyteHD',id=bae2dc53-2e6e-47f3-85f9-39ba8881ee63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bdf3fd04cf4c1d9ba68d0cabcfdd30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:24:54Z,use_quota=True,user_id='42e952b904244863b80757d630857f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f080f6f-caae-4bc4-ba06-08c7069ac2a8),volume_type_id=8f080f6f-caae-4bc4-ba06-08c7069ac2a8)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc124fd-ff8d-4851-9732-0aeeb85352d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc124fd-ff8d-4851-9732-0aeeb85352d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11358ce9-b2dd-49a4-b9ca-e68447c146aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11358ce9-b2dd-49a4-b9ca-e68447c146aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae2dc53-2e6e-47f3-85f9-39ba8881ee63', 'volume_name': 'volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1743f230-2109-4b64-a0d0-55a03d7e2de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1743f230-2109-4b64-a0d0-55a03d7e2de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad9d9a09-add8-4e10-9296-92f4954c2516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:54 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Volume bae2dc53-2e6e-47f3-85f9-39ba8881ee63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63', 'volume_size': 1} Jul 23 22:24:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:54 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 1G" returned: 0 in 0.754s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37757887-e2fc-430b-86d0-1203f4ffa3ef -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:54 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37757887-e2fc-430b-86d0-1203f4ffa3ef -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 Jul 23 22:24:54 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:55 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37757887-e2fc-430b-86d0-1203f4ffa3ef -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6" returned: 0 in 0.413s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:55 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 22:24:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:55 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 Jul 23 22:24:55 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:55 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6" returned: 0 in 0.332s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:55 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.info Jul 23 22:24:55 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:55 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.info" returned: 0 in 0.341s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:55 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 22:24:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:55 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.info Jul 23 22:24:55 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:56 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.info" returned: 0 in 0.258s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.695s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.499s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=75d98086-3b0b-4714-97fb-158786380d23,created_at=2026-07-23T20:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1523089277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=75d98086-3b0b-4714-97fb-158786380d23,host='devstack@QuobyteHD#QuobyteHD',id=bae2dc53-2e6e-47f3-85f9-39ba8881ee63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bdf3fd04cf4c1d9ba68d0cabcfdd30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:24:54Z,use_quota=True,user_id='42e952b904244863b80757d630857f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f080f6f-caae-4bc4-ba06-08c7069ac2a8),volume_type_id=8f080f6f-caae-4bc4-ba06-08c7069ac2a8)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:24:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Creating volume bae2dc53-2e6e-47f3-85f9-39ba8881ee63 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:24:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:24:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:24:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:24:56 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:24:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:56 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 1073741824 Jul 23 22:24:56 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:56 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a036e4fc-139d-4260-a3bf-0ea477b513be tempest-GroupSnapshotsTest-1247013327 None] group_snapshot de4b8c0d-c074-49ad-9a2a-c025e8454bb7: created successfully Jul 23 22:24:56 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 1073741824" returned: 0 in 0.585s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:56 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 Jul 23 22:24:56 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:57 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63" returned: 0 in 0.438s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad9d9a09-add8-4e10-9296-92f4954c2516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2e866c-af06-4ba8-bd46-51cf87b3cdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:24:57 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Volume volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 (bae2dc53-2e6e-47f3-85f9-39ba8881ee63): created successfully Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2e866c-af06-4ba8-bd46-51cf87b3cdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Flow 'volume_create_manager' (68468d63-bb21-492b-bb89-37dbddaf188b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:24:57 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-989bec97-3d81-425f-ab7b-c67479862aa5 tempest-GroupSnapshotsV319Test-123895909 None] Created volume successfully. Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "cinder-quobyte-fff82af4-71f8-4a63-9d6b-a481876e3ce6-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6" by "_create_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-fff82af4-71f8-4a63-9d6b-a481876e3ce6-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Creating volume b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6 from snapshot fff82af4-71f8-4a63-9d6b-a481876e3ce6 {{(pid=88308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "cinder-quobyte-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6" by "_copy_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] snapshot: fff82af4-71f8-4a63-9d6b-a481876e3ce6, volume: b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6, {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe4cae6-92b4-4aa7-bc85-fa741864c44a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:24:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:58 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 Jul 23 22:24:58 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "cinder-59bda607-be4c-4266-a8c9-5ece42c153fa-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:24:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Lock "cinder-59bda607-be4c-4266-a8c9-5ece42c153fa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:24:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "cinder-quobyte-59bda607-be4c-4266-a8c9-5ece42c153fa" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:24:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Lock "cinder-quobyte-59bda607-be4c-4266-a8c9-5ece42c153fa" acquired by "delete_volume" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:24:58 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[697dd2d2-a2ea-4e1e-9518-fef35c672c32]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:24:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-59bda607-be4c-4266-a8c9-5ece42c153fa {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:58 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-59bda607-be4c-4266-a8c9-5ece42c153fa Jul 23 22:24:58 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:58 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6" returned: 0 in 0.565s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37757887-e2fc-430b-86d0-1203f4ffa3ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:24:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 23 22:24:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Creating direct copy from snapshot {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 23 22:24:58 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[19718c62-a925-4879-9def-cc8b1ae41889]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:24:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:58 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef Jul 23 22:24:58 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:58 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-59bda607-be4c-4266-a8c9-5ece42c153fa" returned: 0 in 0.477s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-59bda607-be4c-4266-a8c9-5ece42c153fa {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:58 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-59bda607-be4c-4266-a8c9-5ece42c153fa Jul 23 22:24:58 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:58 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] GroupSnapshot 2ca9d050-93e4-4701-b35d-348b2d1b01a3: creating. Jul 23 22:24:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] Group snapshot 2ca9d050-93e4-4701-b35d-348b2d1b01a3: creating. {{(pid=88308) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 22:24:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:59 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef" returned: 0 in 0.607s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:59 devstack cinder-volume[88308]: DEBUG cinder.utils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Path /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6 not found in is_blk_device check {{(pid=88308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 22:24:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:59 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6 Jul 23 22:24:59 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:24:59 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Jul 23 22:24:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-59bda607-be4c-4266-a8c9-5ece42c153fa" returned: 0 in 0.470s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:24:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Lock "cinder-quobyte-59bda607-be4c-4266-a8c9-5ece42c153fa" released by "delete_volume" :: held 1.037s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:24:59 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Created reservations ['3c71df48-19a2-4ca1-a9df-5da7e885dce2', 'e20de2df-999d-45f0-a8f7-18844783ceef', '907e7734-864d-4576-8dfa-842b6db7f39e', '7ef0fe2a-ff44-4b38-8823-f3dc8925b46d'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:24:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:24:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:24:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:24:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:24:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:24:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:24:59 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:24:59 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:00 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.695s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:00 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:00 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Deleted volume successfully. Jul 23 22:25:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-52c2cffc-aebc-484a-9e0c-ff70a9bf891d tempest-AttachVolumeTestJSON-111733113 None] Lock "cinder-59bda607-be4c-4266-a8c9-5ece42c153fa-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "cinder-7dcd0d71-1a1a-4566-80cc-a08d6a834f93-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Lock "cinder-7dcd0d71-1a1a-4566-80cc-a08d6a834f93-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "cinder-quobyte-7dcd0d71-1a1a-4566-80cc-a08d6a834f93" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Lock "cinder-quobyte-7dcd0d71-1a1a-4566-80cc-a08d6a834f93" acquired by "delete_volume" :: waited 0.026s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:00 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d37b670-c377-4f75-8c64-f54f42258936]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:01 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93 Jul 23 22:25:01 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:02 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93" returned: 0 in 1.406s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:02 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93 Jul 23 22:25:02 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:02 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7dcd0d71-1a1a-4566-80cc-a08d6a834f93" returned: 0 in 0.481s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:02 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Lock "cinder-quobyte-7dcd0d71-1a1a-4566-80cc-a08d6a834f93" released by "delete_volume" :: held 2.073s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:03 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Created reservations ['37b43703-02a8-4c4e-a678-b0b6ad3c1e65', 'd898064a-7f73-4fb6-9c3b-b9b756f508ba', 'cfae8814-40dd-459e-b7d0-a4a9d93b16d9', '41dfb794-dfb0-4fed-bdea-f898d44ce008'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:03 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:25:03 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:03 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "cinder-08d89abb-d46d-4a16-96aa-872b85d58f95-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:03 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Lock "cinder-08d89abb-d46d-4a16-96aa-872b85d58f95-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:04 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.891s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:04 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:04 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Deleted volume successfully. Jul 23 22:25:04 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "cinder-quobyte-08d89abb-d46d-4a16-96aa-872b85d58f95" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:04 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4bae4201-4bc9-4e0b-a807-a2a083866939 tempest-AttachVolumeTestJSON-111733113 None] Lock "cinder-7dcd0d71-1a1a-4566-80cc-a08d6a834f93-delete_volume" released by "delete_volume" :: held 3.435s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:04 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Lock "cinder-quobyte-08d89abb-d46d-4a16-96aa-872b85d58f95" acquired by "delete_volume" :: waited 0.040s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:04 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7077c75-dca7-47c4-a175-bb010c4b4909]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08d89abb-d46d-4a16-96aa-872b85d58f95 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:04 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08d89abb-d46d-4a16-96aa-872b85d58f95 Jul 23 22:25:04 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:05 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08d89abb-d46d-4a16-96aa-872b85d58f95" returned: 0 in 1.239s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08d89abb-d46d-4a16-96aa-872b85d58f95 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:05 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08d89abb-d46d-4a16-96aa-872b85d58f95 Jul 23 22:25:05 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:05 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6" returned: 0 in 6.888s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:05 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ae8622-775a-4cac-9cb7-20aae0f2f9fd]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:06 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef Jul 23 22:25:06 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:06 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08d89abb-d46d-4a16-96aa-872b85d58f95" returned: 0 in 0.777s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:06 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Lock "cinder-quobyte-08d89abb-d46d-4a16-96aa-872b85d58f95" released by "delete_volume" :: held 2.129s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:06 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Created reservations ['bd885983-b6ee-4cd8-98b1-130c9ac3a8c8', 'b441f03c-4eda-44f9-9515-644661604462', 'bc778273-9ea3-4537-a1e2-07f301a62501', 'c7f83f30-2197-407b-a778-216cef487193'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:06 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:25:06 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:07 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.544s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:07 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:07 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef" returned: 0 in 1.089s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:07 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef, size 1024.00 MB, duration 6.89 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6 {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:25:07 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Converted 1024.00 MB image at 148.64 MB/s Jul 23 22:25:07 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 22:25:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:07 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Deleted volume successfully. Jul 23 22:25:07 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6 Jul 23 22:25:07 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f5cc0266-72a2-4dd2-a79e-e7feb34c8941 tempest-AttachVolumeTestJSON-111733113 None] Lock "cinder-08d89abb-d46d-4a16-96aa-872b85d58f95-delete_volume" released by "delete_volume" :: held 3.240s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:07 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6" returned: 0 in 0.362s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6" released by "_copy_volume_from_snapshot" :: held 9.714s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-fff82af4-71f8-4a63-9d6b-a481876e3ce6-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6" released by "_create_volume_from_snapshot" :: held 9.753s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.779s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.527s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] Creating offline snapshot 7b91f332-2745-477b-a8b2-aeed47818184 of volume bae2dc53-2e6e-47f3-85f9-39ba8881ee63 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:25:07 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50da519-b6ef-4125-b1d2-2d9feb026fe3]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:07 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-bc9e49f3-ce37-468c-93fe-e89e1f66bf26 tempest-GroupSnapshotsTest-1247013327 None] Create group from source-snapshot-de4b8c0d-c074-49ad-9a2a-c025e8454bb7 completed successfully. Jul 23 22:25:07 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 Jul 23 22:25:07 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:07 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63" returned: 0 in 0.414s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:08 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184 1G Jul 23 22:25:08 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:08 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184 1G" returned: 0 in 0.634s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:08 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184 Jul 23 22:25:08 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:09 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184" returned: 0 in 0.527s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:09 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 22:25:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:09 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184 Jul 23 22:25:09 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "cinder-quobyte-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6" acquired by "delete_volume" :: waited 0.033s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:09 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[92191de3-f062-4e0e-b640-91024a65a449]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:09 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6 Jul 23 22:25:09 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:09 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184" returned: 0 in 0.388s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:09 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.info Jul 23 22:25:09 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:09 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6" returned: 0 in 0.537s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:09 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6 Jul 23 22:25:09 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:09 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.info" returned: 0 in 0.336s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:09 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 22:25:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:09 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.info Jul 23 22:25:09 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:10 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6" returned: 0 in 0.409s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:10 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-b37d2b4c-abd4-4a62-88ca-cf4400dc1ca6" released by "delete_volume" :: held 1.014s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.info" returned: 0 in 0.373s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.810s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:10 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Created reservations ['c20ffb11-4f59-495e-a795-4cea928d69f9'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:10 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-91535b39-51e9-4bd5-8509-0ae17498827e tempest-GroupSnapshotsV319Test-123895909 None] group_snapshot 2ca9d050-93e4-4701-b35d-348b2d1b01a3: created successfully Jul 23 22:25:10 devstack cinder-volume[88308]: WARNING cinder.quota [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-356691953 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-356691953, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:25:10 devstack cinder-volume[88308]: WARNING cinder.quota [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-356691953 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-356691953, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:25:10 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Created reservations ['32cbc383-95fc-4b88-8692-41f8b69600ec', '01ec74c0-c4d2-4298-a76e-f639b4d27ad2', '5a972555-97a2-4b39-be0e-c9a135aa2c9b', '9980f1d6-3336-461c-bca7-3f3d3059079f'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:10 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:25:10 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:10 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] group_snapshot de4b8c0d-c074-49ad-9a2a-c025e8454bb7: deleting Jul 23 22:25:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] group_snapshot de4b8c0d-c074-49ad-9a2a-c025e8454bb7: deleting {{(pid=88308) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 22:25:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "cinder-quobyte-37757887-e2fc-430b-86d0-1203f4ffa3ef" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-37757887-e2fc-430b-86d0-1203f4ffa3ef" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "cinder-quobyte-fff82af4-71f8-4a63-9d6b-a481876e3ce6" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-fff82af4-71f8-4a63-9d6b-a481876e3ce6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] Deleting offline snapshot fff82af4-71f8-4a63-9d6b-a481876e3ce6 of volume 37757887-e2fc-430b-86d0-1203f4ffa3ef {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:25:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] snapshot_file for this snap is: volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:25:11 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fa3ab7-25a6-4322-82ad-ecada02a001c]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:11 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.563s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:11 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:11 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-66e614ab-53f3-4650-926f-ca623ca818f2 tempest-GroupSnapshotsTest-1247013327 None] Delete group completed successfully. Jul 23 22:25:11 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 Jul 23 22:25:11 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:11 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6" returned: 0 in 0.840s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37757887-e2fc-430b-86d0-1203f4ffa3ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:25:11 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e333da-c5ef-452b-abfd-9c5c67d61b46]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:12 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] group_snapshot 2ca9d050-93e4-4701-b35d-348b2d1b01a3: deleting Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Flow 'volume_create_manager' (ffb3aa68-3b14-4721-b998-0509c363a950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6ab74a-983d-40cb-9eac-be8b750d21f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6ab74a-983d-40cb-9eac-be8b750d21f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1030840627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ee8023-1b20-4419-ba24-e94e6e9e0101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430dd24b3d5d49eaad405a5ad66000c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:12Z,use_quota=True,user_id='29b3048bf3d64a2a9b3f1d8a335eb74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7e52e9-783e-460a-90ec-0d927c166ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7e52e9-783e-460a-90ec-0d927c166ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2796607f-18f5-44f9-8f26-e6f6ebdf2f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2796607f-18f5-44f9-8f26-e6f6ebdf2f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7ee8023-1b20-4419-ba24-e94e6e9e0101', 'volume_name': 'volume-b7ee8023-1b20-4419-ba24-e94e6e9e0101', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0155691-1bbe-4e4d-bcdb-6940118703f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0155691-1bbe-4e4d-bcdb-6940118703f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:12 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef Jul 23 22:25:12 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5040f7db-f580-4d68-ad9b-f4413139ff0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:12 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Volume b7ee8023-1b20-4419-ba24-e94e6e9e0101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7ee8023-1b20-4419-ba24-e94e6e9e0101', 'volume_size': 1} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1030840627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ee8023-1b20-4419-ba24-e94e6e9e0101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430dd24b3d5d49eaad405a5ad66000c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:12Z,use_quota=True,user_id='29b3048bf3d64a2a9b3f1d8a335eb74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Creating volume b7ee8023-1b20-4419-ba24-e94e6e9e0101 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:25:12 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b7ee8023-1b20-4419-ba24-e94e6e9e0101 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] group_snapshot 2ca9d050-93e4-4701-b35d-348b2d1b01a3: deleting {{(pid=88308) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 22:25:12 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b7ee8023-1b20-4419-ba24-e94e6e9e0101 1073741824 Jul 23 22:25:12 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] Acquiring lock "cinder-quobyte-bae2dc53-2e6e-47f3-85f9-39ba8881ee63" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] Lock "cinder-quobyte-bae2dc53-2e6e-47f3-85f9-39ba8881ee63" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] Acquiring lock "cinder-quobyte-7b91f332-2745-477b-a8b2-aeed47818184" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] Lock "cinder-quobyte-7b91f332-2745-477b-a8b2-aeed47818184" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] Deleting offline snapshot 7b91f332-2745-477b-a8b2-aeed47818184 of volume bae2dc53-2e6e-47f3-85f9-39ba8881ee63 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] snapshot_file for this snap is: volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[de84366f-48e8-486c-8c10-1f3cbc1ebbef]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:12 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184 Jul 23 22:25:12 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:12 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef" returned: 0 in 0.644s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:12 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 Jul 23 22:25:12 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:12 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b7ee8023-1b20-4419-ba24-e94e6e9e0101 1073741824" returned: 0 in 0.768s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:13 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184" returned: 0 in 0.579s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b7ee8023-1b20-4419-ba24-e94e6e9e0101 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b6550b-0c5d-4fe0-841b-88ae0ce25cf4]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:13 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b7ee8023-1b20-4419-ba24-e94e6e9e0101 Jul 23 22:25:13 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:13 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6" returned: 0 in 0.668s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:13 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 Jul 23 22:25:13 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:13 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6 Jul 23 22:25:13 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:13 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b7ee8023-1b20-4419-ba24-e94e6e9e0101" returned: 0 in 0.439s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5040f7db-f580-4d68-ad9b-f4413139ff0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7ee8023-1b20-4419-ba24-e94e6e9e0101', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c757eb6a-2e7d-449d-939c-29f87d7a8cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:13 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Volume volume-b7ee8023-1b20-4419-ba24-e94e6e9e0101 (b7ee8023-1b20-4419-ba24-e94e6e9e0101): created successfully Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c757eb6a-2e7d-449d-939c-29f87d7a8cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Flow 'volume_create_manager' (ffb3aa68-3b14-4721-b998-0509c363a950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:13 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-79f30360-6127-4280-9dbd-ca7c4c776ea5 tempest-VolumesActionsTest-883193912 None] Created volume successfully. Jul 23 22:25:13 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef.fff82af4-71f8-4a63-9d6b-a481876e3ce6" returned: 0 in 0.409s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:13 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-fff82af4-71f8-4a63-9d6b-a481876e3ce6" released by "_delete_snapshot" :: held 2.725s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63" returned: 0 in 0.664s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-37757887-e2fc-430b-86d0-1203f4ffa3ef" released by "delete_snapshot" :: held 2.769s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:13 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184 Jul 23 22:25:13 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:13 devstack cinder-volume[88308]: WARNING cinder.quota [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-356691953 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-356691953, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:25:13 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] Created reservations ['27fa6832-10ed-4092-84a2-a475f269aa51', '90459f1b-20cc-415d-93b2-b780174fa3d7', 'a93acd4d-c3c0-403e-8707-ae8d9c29f423', '3d9b2bd9-c366-48f7-9847-2ac3cd1a22f8'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-36d86404-72c6-4169-9b6e-7c10c4bed12e tempest-VolumesActionsTest-883193912 None] Acquiring lock "cinder-b7ee8023-1b20-4419-ba24-e94e6e9e0101" by "attach_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:14 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b9211328-98b0-477f-9ad0-bcf6e6c91947 tempest-GroupSnapshotsTest-1247013327 None] group_snapshot de4b8c0d-c074-49ad-9a2a-c025e8454bb7: deleted successfully Jul 23 22:25:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-36d86404-72c6-4169-9b6e-7c10c4bed12e tempest-VolumesActionsTest-883193912 None] Lock "cinder-b7ee8023-1b20-4419-ba24-e94e6e9e0101" acquired by "attach_volume" :: waited 0.067s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:14 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-36d86404-72c6-4169-9b6e-7c10c4bed12e tempest-VolumesActionsTest-883193912 None] Attaching volume b7ee8023-1b20-4419-ba24-e94e6e9e0101 to instance cf993434-6913-4080-89fe-b41c992c1268 at mountpoint /dev/vdb on host None. Jul 23 22:25:14 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184" returned: 0 in 0.561s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:14 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184 Jul 23 22:25:14 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:14 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-36d86404-72c6-4169-9b6e-7c10c4bed12e tempest-VolumesActionsTest-883193912 None] Attach volume completed successfully. Jul 23 22:25:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-36d86404-72c6-4169-9b6e-7c10c4bed12e tempest-VolumesActionsTest-883193912 None] Lock "cinder-b7ee8023-1b20-4419-ba24-e94e6e9e0101" released by "attach_volume" :: held 0.172s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:14 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63.7b91f332-2745-477b-a8b2-aeed47818184" returned: 0 in 0.306s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] Lock "cinder-quobyte-7b91f332-2745-477b-a8b2-aeed47818184" released by "_delete_snapshot" :: held 2.245s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] Lock "cinder-quobyte-bae2dc53-2e6e-47f3-85f9-39ba8881ee63" released by "delete_snapshot" :: held 2.289s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:14 devstack cinder-volume[88308]: WARNING cinder.quota [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1254031148 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1254031148, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:25:14 devstack cinder-volume[88308]: WARNING cinder.quota [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1254031148 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1254031148, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:25:14 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] Created reservations ['e79984cd-e334-41fc-8ceb-e720d62d4fba', '14845c83-260b-4084-9cf3-9fee69d4477e', '70e86757-a7dc-4413-b8b0-b6707e15cd62', '0dcc768c-a58e-442a-8fb3-44841bf11c1f'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "cinder-quobyte-37757887-e2fc-430b-86d0-1203f4ffa3ef" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-37757887-e2fc-430b-86d0-1203f4ffa3ef" acquired by "delete_volume" :: waited 0.059s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:15 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f37596d-0df1-4688-ba40-f186e376c456]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:15 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6f7799dd-aea5-4bd8-8a05-7cf241918e2d tempest-GroupSnapshotsV319Test-123895909 None] group_snapshot 2ca9d050-93e4-4701-b35d-348b2d1b01a3: deleted successfully Jul 23 22:25:15 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef Jul 23 22:25:15 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:15 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-0bb943ca-cbed-4eeb-93df-799f4d12ad92 tempest-VolumesActionsTest-1972611281 None] Terminate volume connection completed successfully. Jul 23 22:25:15 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef" returned: 0 in 0.499s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:15 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef Jul 23 22:25:15 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0bb943ca-cbed-4eeb-93df-799f4d12ad92 tempest-VolumesActionsTest-1972611281 None] Acquiring lock "cinder-b7ee8023-1b20-4419-ba24-e94e6e9e0101-detach_volume" by "detach_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0bb943ca-cbed-4eeb-93df-799f4d12ad92 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-b7ee8023-1b20-4419-ba24-e94e6e9e0101-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:15 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-0bb943ca-cbed-4eeb-93df-799f4d12ad92 tempest-VolumesActionsTest-1972611281 None] Detaching volume b7ee8023-1b20-4419-ba24-e94e6e9e0101 from instance cf993434-6913-4080-89fe-b41c992c1268. Jul 23 22:25:15 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-0bb943ca-cbed-4eeb-93df-799f4d12ad92 tempest-VolumesActionsTest-1972611281 None] Detach volume completed successfully. Jul 23 22:25:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0bb943ca-cbed-4eeb-93df-799f4d12ad92 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-b7ee8023-1b20-4419-ba24-e94e6e9e0101-detach_volume" released by "detach_volume" :: held 0.146s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] Acquiring lock "cinder-quobyte-bae2dc53-2e6e-47f3-85f9-39ba8881ee63" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:16 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-37757887-e2fc-430b-86d0-1203f4ffa3ef" returned: 0 in 0.466s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] Lock "cinder-quobyte-bae2dc53-2e6e-47f3-85f9-39ba8881ee63" acquired by "delete_volume" :: waited 0.046s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6094a3f0-6030-458c-bddd-4df9ece89b3a tempest-VolumesActionsTest-883193912 None] Acquiring lock "cinder-b7ee8023-1b20-4419-ba24-e94e6e9e0101-detach_volume" by "detach_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd20857-ae24-4ed6-86af-816520a5f2ee]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-37757887-e2fc-430b-86d0-1203f4ffa3ef" released by "delete_volume" :: held 1.142s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6094a3f0-6030-458c-bddd-4df9ece89b3a tempest-VolumesActionsTest-883193912 None] Lock "cinder-b7ee8023-1b20-4419-ba24-e94e6e9e0101-detach_volume" acquired by "detach_volume" :: waited 0.078s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:16 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6094a3f0-6030-458c-bddd-4df9ece89b3a tempest-VolumesActionsTest-883193912 None] Volume detach called, but volume not attached. Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6094a3f0-6030-458c-bddd-4df9ece89b3a tempest-VolumesActionsTest-883193912 None] Lock "cinder-b7ee8023-1b20-4419-ba24-e94e6e9e0101-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] Created reservations ['26745a9f-3eb0-44fd-a5d9-b0af78be4ad4'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:16 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 Jul 23 22:25:16 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:16 devstack cinder-volume[88308]: WARNING cinder.db.api [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-356691953'] Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] Created reservations ['91ab337c-1c0f-4d59-9883-7d3d27fb01c0', 'd6dbaac9-2f25-4fc3-a1ff-98cb8b845428', 'a32f39f2-952f-4585-8bd7-033f061c6517', '5f49c0e5-cc64-4946-82e8-e27081eaae2c'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Acquiring lock "cinder-b7ee8023-1b20-4419-ba24-e94e6e9e0101-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:16 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:25:16 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Lock "cinder-b7ee8023-1b20-4419-ba24-e94e6e9e0101-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Acquiring lock "cinder-quobyte-b7ee8023-1b20-4419-ba24-e94e6e9e0101" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Lock "cinder-quobyte-b7ee8023-1b20-4419-ba24-e94e6e9e0101" acquired by "delete_volume" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:16 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63" returned: 0 in 0.660s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fb6289-8e6a-48d4-bdee-07929e785a36]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b7ee8023-1b20-4419-ba24-e94e6e9e0101 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:16 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63 Jul 23 22:25:16 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:16 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b7ee8023-1b20-4419-ba24-e94e6e9e0101 Jul 23 22:25:16 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:17 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.420s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:17 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-118d5dd1-9c0d-4efc-8d0d-95f48a7fc737 tempest-GroupSnapshotsTest-1247013327 None] Delete group completed successfully. Jul 23 22:25:17 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bae2dc53-2e6e-47f3-85f9-39ba8881ee63" returned: 0 in 0.329s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] Lock "cinder-quobyte-bae2dc53-2e6e-47f3-85f9-39ba8881ee63" released by "delete_volume" :: held 1.078s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] Created reservations ['c02c2c3a-39e2-4b8c-a146-09dc9a9bcaf8'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:17 devstack cinder-volume[88308]: WARNING cinder.quota [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1254031148 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1254031148, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] Created reservations ['b3b4b53c-4272-4dd1-af55-4ec603989ea1', 'c7ea4b69-61b0-47d6-86b4-424c4051d3ab', '19fce078-d97e-4abe-a9e1-ab59230680b9', '23877133-453d-497a-8461-79137cedd22a'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:17 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b7ee8023-1b20-4419-ba24-e94e6e9e0101" returned: 0 in 0.538s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b7ee8023-1b20-4419-ba24-e94e6e9e0101 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:17 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b7ee8023-1b20-4419-ba24-e94e6e9e0101 Jul 23 22:25:17 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:17 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:25:17 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:17 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b7ee8023-1b20-4419-ba24-e94e6e9e0101" returned: 0 in 0.406s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Lock "cinder-quobyte-b7ee8023-1b20-4419-ba24-e94e6e9e0101" released by "delete_volume" :: held 1.032s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:17 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Created reservations ['489971fe-cc23-475b-a9a8-77fd9c85010c', 'a492a306-e13c-4343-bfef-3c658e459576', '12d90b34-f910-4c82-8ef0-23c6a19f7c38', '3cda8d5c-c4fa-4fe7-b5c2-3b2982981cf8'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:17 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.493s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:18 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:18 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-8fc5096c-220c-40ac-a0cf-274f342904fa tempest-GroupSnapshotsV319Test-123895909 None] Delete group completed successfully. Jul 23 22:25:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:18 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:25:18 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:18 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-0d6a9be1-3033-455e-9509-9f4fcd0ae91f tempest-GroupSnapshotsTest-1247013327 None] Group tempest-GroupSnapshotsTest-Group-1830725941: creating Jul 23 22:25:18 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:18 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-0d6a9be1-3033-455e-9509-9f4fcd0ae91f tempest-GroupSnapshotsTest-1247013327 None] Group tempest-GroupSnapshotsTest-Group-1830725941: created successfully Jul 23 22:25:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.439s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:18 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:18 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Deleted volume successfully. Jul 23 22:25:18 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-0d6a9be1-3033-455e-9509-9f4fcd0ae91f tempest-GroupSnapshotsTest-1247013327 None] Create group completed successfully. Jul 23 22:25:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6578e4c9-ff65-4fc9-9fe9-599061294f65 tempest-VolumesActionsTest-883193912 None] Lock "cinder-b7ee8023-1b20-4419-ba24-e94e6e9e0101-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Flow 'volume_create_manager' (07b05a81-cfc0-45ee-a27e-e4d18f6cd40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2e09b9-1792-4f15-a685-6a430211cd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2e09b9-1792-4f15-a685-6a430211cd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2000786411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=427384f8-908d-4114-bf47-e52819092128,host='devstack@QuobyteHD#QuobyteHD',id=f62c4f51-6605-4e31-942d-637fc68c53e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7893fc2bfdf74a1189a29ea49fffe54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:20Z,use_quota=True,user_id='6b6b0471606d4d8cbd4ffff133c42b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2db3dcaf-1a15-48bf-a3c5-e2b1128daa08),volume_type_id=2db3dcaf-1a15-48bf-a3c5-e2b1128daa08)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72c3033-a05c-46ba-bf7b-f5a08570d961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72c3033-a05c-46ba-bf7b-f5a08570d961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834be3f1-0fcc-4f55-af5b-86ecc7aa6b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834be3f1-0fcc-4f55-af5b-86ecc7aa6b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f62c4f51-6605-4e31-942d-637fc68c53e4', 'volume_name': 'volume-f62c4f51-6605-4e31-942d-637fc68c53e4', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea5fc2f-d89a-4aab-8499-578f718dfef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea5fc2f-d89a-4aab-8499-578f718dfef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464be3f7-6690-402b-9c71-cbf57d58f216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:20 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Volume f62c4f51-6605-4e31-942d-637fc68c53e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f62c4f51-6605-4e31-942d-637fc68c53e4', 'volume_size': 1} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=427384f8-908d-4114-bf47-e52819092128,created_at=2026-07-23T20:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2000786411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=427384f8-908d-4114-bf47-e52819092128,host='devstack@QuobyteHD#QuobyteHD',id=f62c4f51-6605-4e31-942d-637fc68c53e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7893fc2bfdf74a1189a29ea49fffe54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:20Z,use_quota=True,user_id='6b6b0471606d4d8cbd4ffff133c42b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2db3dcaf-1a15-48bf-a3c5-e2b1128daa08),volume_type_id=2db3dcaf-1a15-48bf-a3c5-e2b1128daa08)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Creating volume f62c4f51-6605-4e31-942d-637fc68c53e4 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:25:20 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:25:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:20 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4 1073741824 Jul 23 22:25:20 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:21 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4 1073741824" returned: 0 in 0.607s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:21 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4 Jul 23 22:25:21 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:21 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4" returned: 0 in 0.293s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:25:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464be3f7-6690-402b-9c71-cbf57d58f216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62c4f51-6605-4e31-942d-637fc68c53e4', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e96da6d-f44e-4569-a28a-cf481d4f9518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:21 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Volume volume-f62c4f51-6605-4e31-942d-637fc68c53e4 (f62c4f51-6605-4e31-942d-637fc68c53e4): created successfully Jul 23 22:25:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e96da6d-f44e-4569-a28a-cf481d4f9518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Flow 'volume_create_manager' (07b05a81-cfc0-45ee-a27e-e4d18f6cd40d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:21 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-22f20125-fd1d-433d-8687-77a14feb84ca tempest-GroupSnapshotsTest-1247013327 None] Created volume successfully. Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Flow 'volume_create_manager' (3fa843f9-4183-4569-8c00-264e41b67825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52652773-c890-4dea-b6be-65c5cf8f92a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52652773-c890-4dea-b6be-65c5cf8f92a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-14708024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=427384f8-908d-4114-bf47-e52819092128,host='devstack@QuobyteHD#QuobyteHD',id=4a64b206-9cb7-4150-a713-736b9df37274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7893fc2bfdf74a1189a29ea49fffe54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:23Z,use_quota=True,user_id='6b6b0471606d4d8cbd4ffff133c42b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2db3dcaf-1a15-48bf-a3c5-e2b1128daa08),volume_type_id=2db3dcaf-1a15-48bf-a3c5-e2b1128daa08)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d41e714-692c-4753-83ef-448c396be7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d41e714-692c-4753-83ef-448c396be7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abac7953-c0d2-4e58-b809-9a78f2a51a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abac7953-c0d2-4e58-b809-9a78f2a51a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a64b206-9cb7-4150-a713-736b9df37274', 'volume_name': 'volume-4a64b206-9cb7-4150-a713-736b9df37274', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d9f3f2-8286-4de9-8800-982daefbb13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d9f3f2-8286-4de9-8800-982daefbb13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62d6e97-75bc-4ccf-9b37-18fb423f1a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:22 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Volume 4a64b206-9cb7-4150-a713-736b9df37274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a64b206-9cb7-4150-a713-736b9df37274', 'volume_size': 1} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=427384f8-908d-4114-bf47-e52819092128,created_at=2026-07-23T20:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-14708024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=427384f8-908d-4114-bf47-e52819092128,host='devstack@QuobyteHD#QuobyteHD',id=4a64b206-9cb7-4150-a713-736b9df37274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7893fc2bfdf74a1189a29ea49fffe54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:23Z,use_quota=True,user_id='6b6b0471606d4d8cbd4ffff133c42b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2db3dcaf-1a15-48bf-a3c5-e2b1128daa08),volume_type_id=2db3dcaf-1a15-48bf-a3c5-e2b1128daa08)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Creating volume 4a64b206-9cb7-4150-a713-736b9df37274 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:25:22 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:25:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:22 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274 1073741824 Jul 23 22:25:22 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:23 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274 1073741824" returned: 0 in 0.636s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:23 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274 Jul 23 22:25:23 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:25:23 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Flow 'volume_create_manager' (c123846a-7dd1-451c-b50b-b48360bfad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e4cf5c-d547-4f48-9cd8-c8317fde0f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274" returned: 0 in 0.366s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e4cf5c-d547-4f48-9cd8-c8317fde0f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1357838230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48dc66dd-5f0e-4bf1-9a89-493c74631ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430dd24b3d5d49eaad405a5ad66000c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:24Z,use_quota=True,user_id='29b3048bf3d64a2a9b3f1d8a335eb74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34530e84-d1f3-45ac-a408-e32ee5711655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34530e84-d1f3-45ac-a408-e32ee5711655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f969962a-d1e1-4e48-8b87-fd6c00a3cc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f969962a-d1e1-4e48-8b87-fd6c00a3cc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48dc66dd-5f0e-4bf1-9a89-493c74631ce4', 'volume_name': 'volume-48dc66dd-5f0e-4bf1-9a89-493c74631ce4', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3744458-0538-4083-96d0-471afeb676fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3744458-0538-4083-96d0-471afeb676fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc961b3-da44-4d25-be7a-5d7b43d67637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:23 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Volume 48dc66dd-5f0e-4bf1-9a89-493c74631ce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48dc66dd-5f0e-4bf1-9a89-493c74631ce4', 'volume_size': 1} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1357838230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48dc66dd-5f0e-4bf1-9a89-493c74631ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430dd24b3d5d49eaad405a5ad66000c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:24Z,use_quota=True,user_id='29b3048bf3d64a2a9b3f1d8a335eb74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Creating volume 48dc66dd-5f0e-4bf1-9a89-493c74631ce4 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:25:23 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48dc66dd-5f0e-4bf1-9a89-493c74631ce4 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62d6e97-75bc-4ccf-9b37-18fb423f1a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a64b206-9cb7-4150-a713-736b9df37274', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6720f6e6-7800-49d4-9b5c-5d6593160e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:23 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Volume volume-4a64b206-9cb7-4150-a713-736b9df37274 (4a64b206-9cb7-4150-a713-736b9df37274): created successfully Jul 23 22:25:23 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48dc66dd-5f0e-4bf1-9a89-493c74631ce4 1073741824 Jul 23 22:25:23 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6720f6e6-7800-49d4-9b5c-5d6593160e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Flow 'volume_create_manager' (3fa843f9-4183-4569-8c00-264e41b67825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:23 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-acf783a8-ad8b-44da-be59-f18b5f03dbfa tempest-GroupSnapshotsTest-1247013327 None] Created volume successfully. Jul 23 22:25:24 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48dc66dd-5f0e-4bf1-9a89-493c74631ce4 1073741824" returned: 0 in 0.635s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48dc66dd-5f0e-4bf1-9a89-493c74631ce4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:24 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48dc66dd-5f0e-4bf1-9a89-493c74631ce4 Jul 23 22:25:24 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:24 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48dc66dd-5f0e-4bf1-9a89-493c74631ce4" returned: 0 in 0.345s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:25:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc961b3-da44-4d25-be7a-5d7b43d67637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48dc66dd-5f0e-4bf1-9a89-493c74631ce4', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0ce19b-b4e0-4500-954c-97fa771a8f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:24 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Volume volume-48dc66dd-5f0e-4bf1-9a89-493c74631ce4 (48dc66dd-5f0e-4bf1-9a89-493c74631ce4): created successfully Jul 23 22:25:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0ce19b-b4e0-4500-954c-97fa771a8f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Flow 'volume_create_manager' (c123846a-7dd1-451c-b50b-b48360bfad21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:25 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2525a16d-f4c2-44c8-b7c9-e199c04570f5 tempest-VolumesActionsTest-883193912 None] Created volume successfully. Jul 23 22:25:25 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-3df8f3c1-27c2-4250-b395-5d5bc6cd20e3 tempest-GroupSnapshotsTest-1247013327 None] Update group completed successfully. Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:26 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:25:26 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Acquiring lock "cinder-48dc66dd-5f0e-4bf1-9a89-493c74631ce4-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-48dc66dd-5f0e-4bf1-9a89-493c74631ce4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Acquiring lock "cinder-quobyte-48dc66dd-5f0e-4bf1-9a89-493c74631ce4" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-quobyte-48dc66dd-5f0e-4bf1-9a89-493c74631ce4" acquired by "delete_volume" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10747df-7d05-4fec-9f40-9b7edc0a5828]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48dc66dd-5f0e-4bf1-9a89-493c74631ce4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:26 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48dc66dd-5f0e-4bf1-9a89-493c74631ce4 Jul 23 22:25:26 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:26 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.443s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 8 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:25:26 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-d7ac694c-733a-49e7-86d4-e777e65d298a tempest-GroupSnapshotsTest-1247013327 None] Update group completed successfully. Jul 23 22:25:26 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48dc66dd-5f0e-4bf1-9a89-493c74631ce4" returned: 0 in 0.466s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48dc66dd-5f0e-4bf1-9a89-493c74631ce4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:26 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48dc66dd-5f0e-4bf1-9a89-493c74631ce4 Jul 23 22:25:26 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:26 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48dc66dd-5f0e-4bf1-9a89-493c74631ce4" returned: 0 in 0.265s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-quobyte-48dc66dd-5f0e-4bf1-9a89-493c74631ce4" released by "delete_volume" :: held 0.792s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:27 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Created reservations ['c7cb2792-f37c-4c40-8633-e7094779ce42', '52f91f54-c056-4202-9626-2ac271ea1c9c', '0b7fffb8-ec58-4584-b333-ea1948e81cf1', '585f5550-3896-4cde-a4f9-c2714e1af557'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:27 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:25:27 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:27 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.308s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:27 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:27 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Deleted volume successfully. Jul 23 22:25:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-49c4d0bc-2b18-4f2f-a64c-be79edd978a6 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-48dc66dd-5f0e-4bf1-9a89-493c74631ce4-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:27 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-bf324a20-c73a-48ee-8771-dcef675d4030 tempest-GroupSnapshotsTest-1247013327 None] Update group completed successfully. Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Flow 'volume_create_manager' (b3870e49-1e2f-419b-8445-31b01c73d562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbd9088-b115-43b4-87f0-95cbf66c2814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbd9088-b115-43b4-87f0-95cbf66c2814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-464956267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39e2b37-1d0c-4bf2-afaa-aa498e285ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430dd24b3d5d49eaad405a5ad66000c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:28Z,use_quota=True,user_id='29b3048bf3d64a2a9b3f1d8a335eb74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e8c105-7538-49ec-8a5f-138df15c771c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e8c105-7538-49ec-8a5f-138df15c771c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32e96f3-c031-4069-a377-1e0549d6df20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32e96f3-c031-4069-a377-1e0549d6df20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c39e2b37-1d0c-4bf2-afaa-aa498e285ce7', 'volume_name': 'volume-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14dbfed8-f1b7-4e9c-9200-7664db27765b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14dbfed8-f1b7-4e9c-9200-7664db27765b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd14942d-b6e0-4499-ac67-3eb3d95aae52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:28 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Volume c39e2b37-1d0c-4bf2-afaa-aa498e285ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7', 'volume_size': 1} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-464956267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39e2b37-1d0c-4bf2-afaa-aa498e285ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430dd24b3d5d49eaad405a5ad66000c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:28Z,use_quota=True,user_id='29b3048bf3d64a2a9b3f1d8a335eb74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Creating volume c39e2b37-1d0c-4bf2-afaa-aa498e285ce7 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:25:28 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:28 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7 1073741824 Jul 23 22:25:28 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:28 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7 1073741824" returned: 0 in 0.536s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:28 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7 Jul 23 22:25:28 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:29 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7" returned: 0 in 0.379s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:25:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:29 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-83c59c61-f499-45a3-b1f5-4b80f28a6e13 tempest-GroupSnapshotsTest-1247013327 None] Update group completed successfully. Jul 23 22:25:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd14942d-b6e0-4499-ac67-3eb3d95aae52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc1996a-d503-4001-a3cf-1901d4c44373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:29 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Volume volume-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7 (c39e2b37-1d0c-4bf2-afaa-aa498e285ce7): created successfully Jul 23 22:25:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc1996a-d503-4001-a3cf-1901d4c44373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Flow 'volume_create_manager' (b3870e49-1e2f-419b-8445-31b01c73d562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:29 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-477c817f-28ba-4108-af40-c41b61bc5013 tempest-VolumesActionsTest-883193912 None] Created volume successfully. Jul 23 22:25:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Acquiring lock "cinder-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Acquiring lock "cinder-quobyte-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-quobyte-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7" acquired by "delete_volume" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:30 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6801038-251e-432e-bba4-55e19a12c10f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:30 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7 Jul 23 22:25:30 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:31 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] GroupSnapshot 73eff34e-ee47-4e16-a4da-74d776fcab29: creating. Jul 23 22:25:31 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7" returned: 0 in 0.601s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Group snapshot 73eff34e-ee47-4e16-a4da-74d776fcab29: creating. {{(pid=88308) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 22:25:31 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7 Jul 23 22:25:31 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Creating offline snapshot 0a1101e5-30bf-4050-b4f6-2dc580616f80 of volume f62c4f51-6605-4e31-942d-637fc68c53e4 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7791d459-cec4-45c3-befe-173328cdf0f6]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:31 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4 Jul 23 22:25:31 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:31 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7" returned: 0 in 0.358s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-quobyte-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7" released by "delete_volume" :: held 1.063s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Created reservations ['39f82a63-86eb-4c17-b996-ee761cb8e2e0', '75834ad9-cb4a-42df-95bd-24213f3d8ab9', 'e70fa11d-f5a0-4cc7-81ef-dd19e85387ac', 'd5d51f0a-55b3-4a36-a017-b7301e558268'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:31 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:25:31 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:31 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4" returned: 0 in 0.694s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:31 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80 1G Jul 23 22:25:31 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:32 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.289s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:32 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:32 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Deleted volume successfully. Jul 23 22:25:32 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-abdd0ee0-a387-45ee-b945-7108342deca0 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-c39e2b37-1d0c-4bf2-afaa-aa498e285ce7-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:32 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80 1G" returned: 0 in 0.515s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f62c4f51-6605-4e31-942d-637fc68c53e4 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:32 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f62c4f51-6605-4e31-942d-637fc68c53e4 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80 Jul 23 22:25:32 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:32 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4204ccde-21a7-4638-b9c0-521959996198 tempest-GroupsTest-911798911 None] Group tempest-Group1-2069194396: creating Jul 23 22:25:32 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4204ccde-21a7-4638-b9c0-521959996198 tempest-GroupsTest-911798911 None] Group tempest-Group1-2069194396: created successfully Jul 23 22:25:32 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4204ccde-21a7-4638-b9c0-521959996198 tempest-GroupsTest-911798911 None] Create group completed successfully. Jul 23 22:25:32 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f62c4f51-6605-4e31-942d-637fc68c53e4 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80" returned: 0 in 0.329s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:32 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 22:25:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:32 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80 Jul 23 22:25:32 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:33 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80" returned: 0 in 0.314s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:33 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.info Jul 23 22:25:33 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Flow 'volume_create_manager' (e59a877b-af83-4ea5-b81b-7551707f191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3664a6b7-96f5-45b2-aa4a-fd5020d6f5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3664a6b7-96f5-45b2-aa4a-fd5020d6f5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1955183978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8acbd7ea-e534-4086-a1a8-e354fecdefe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430dd24b3d5d49eaad405a5ad66000c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:33Z,use_quota=True,user_id='29b3048bf3d64a2a9b3f1d8a335eb74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32198dc1-a5d5-4b93-a65d-72d8ecbdbc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32198dc1-a5d5-4b93-a65d-72d8ecbdbc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0efa56b0-8d57-4529-8254-70d031ad8080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0efa56b0-8d57-4529-8254-70d031ad8080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8acbd7ea-e534-4086-a1a8-e354fecdefe5', 'volume_name': 'volume-8acbd7ea-e534-4086-a1a8-e354fecdefe5', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba93f40-0e8a-47a9-bdd9-36dab5236e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba93f40-0e8a-47a9-bdd9-36dab5236e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa05d81d-3a13-4b70-9729-a337861910b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:33 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Volume 8acbd7ea-e534-4086-a1a8-e354fecdefe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8acbd7ea-e534-4086-a1a8-e354fecdefe5', 'volume_size': 1} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:33 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.info" returned: 0 in 0.279s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:33 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:33 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.info Jul 23 22:25:33 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:33 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.info" returned: 0 in 0.316s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.565s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Creating offline snapshot ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd of volume 4a64b206-9cb7-4150-a713-736b9df37274 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b2ae6c-b4c5-4469-8537-d112122636e6]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:33 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-151c061c-2d05-4614-a764-47518d24ec06 tempest-GroupsTest-911798911 None] Group tempest-Group2-433476473: creating Jul 23 22:25:33 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-151c061c-2d05-4614-a764-47518d24ec06 tempest-GroupsTest-911798911 None] Group tempest-Group2-433476473: created successfully Jul 23 22:25:33 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-151c061c-2d05-4614-a764-47518d24ec06 tempest-GroupsTest-911798911 None] Create group completed successfully. Jul 23 22:25:33 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274 Jul 23 22:25:33 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:34 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274" returned: 0 in 0.386s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:34 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd 1G Jul 23 22:25:34 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:34 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd 1G" returned: 0 in 0.441s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a64b206-9cb7-4150-a713-736b9df37274 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:34 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a64b206-9cb7-4150-a713-736b9df37274 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd Jul 23 22:25:34 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:34 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a64b206-9cb7-4150-a713-736b9df37274 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd" returned: 0 in 0.324s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:34 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd is being set with open permissions: ugo+rw: NotImplementedError Jul 23 22:25:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:34 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd Jul 23 22:25:34 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:35 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd" returned: 0 in 0.280s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:35 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.info Jul 23 22:25:35 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Flow 'volume_create_manager' (75a1b1d1-b93e-4654-86b4-ce023e625221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3830480f-ec14-48f9-bd8b-3c82b7886cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3830480f-ec14-48f9-bd8b-3c82b7886cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1848671791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1627070c-23fa-4911-a30b-057b86e7a02b,host='devstack@QuobyteHD#QuobyteHD',id=caf45567-75a5-4d2a-a5a6-52f65be10d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e952acc4f54672864a8e4e6401153f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:35Z,use_quota=True,user_id='a8bf68ebf5ba41a38a7381ca7a4af22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49b42d1b-2be8-4082-a300-8399139c06d7),volume_type_id=49b42d1b-2be8-4082-a300-8399139c06d7)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b59c4b-4aa0-4a1f-b2e3-8c9e312e424f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b59c4b-4aa0-4a1f-b2e3-8c9e312e424f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:35 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f85e694-ad5c-4e8f-89dc-8110e12011b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f85e694-ad5c-4e8f-89dc-8110e12011b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caf45567-75a5-4d2a-a5a6-52f65be10d2f', 'volume_name': 'volume-caf45567-75a5-4d2a-a5a6-52f65be10d2f', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd57b528-31ee-40c4-8709-ad16a58d4ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd57b528-31ee-40c4-8709-ad16a58d4ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c594bc72-69f6-4a84-bdd0-3cc6122305be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:35 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Volume caf45567-75a5-4d2a-a5a6-52f65be10d2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caf45567-75a5-4d2a-a5a6-52f65be10d2f', 'volume_size': 1} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.info" returned: 0 in 0.376s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:35 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:35 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.info Jul 23 22:25:35 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:35 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.info" returned: 0 in 0.279s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.601s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1955183978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8acbd7ea-e534-4086-a1a8-e354fecdefe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430dd24b3d5d49eaad405a5ad66000c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:33Z,use_quota=True,user_id='29b3048bf3d64a2a9b3f1d8a335eb74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Creating volume 8acbd7ea-e534-4086-a1a8-e354fecdefe5 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:25:35 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:25:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8acbd7ea-e534-4086-a1a8-e354fecdefe5 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:36 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8acbd7ea-e534-4086-a1a8-e354fecdefe5 1073741824 Jul 23 22:25:36 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:36 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-11c0c908-dcae-4436-902c-c4584055367c tempest-GroupSnapshotsTest-1247013327 None] group_snapshot 73eff34e-ee47-4e16-a4da-74d776fcab29: created successfully Jul 23 22:25:36 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8acbd7ea-e534-4086-a1a8-e354fecdefe5 1073741824" returned: 0 in 0.574s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:36 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] group_snapshot 73eff34e-ee47-4e16-a4da-74d776fcab29: deleting Jul 23 22:25:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] group_snapshot 73eff34e-ee47-4e16-a4da-74d776fcab29: deleting {{(pid=88308) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 22:25:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8acbd7ea-e534-4086-a1a8-e354fecdefe5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:36 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8acbd7ea-e534-4086-a1a8-e354fecdefe5 Jul 23 22:25:36 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "cinder-quobyte-f62c4f51-6605-4e31-942d-637fc68c53e4" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-f62c4f51-6605-4e31-942d-637fc68c53e4" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "cinder-quobyte-0a1101e5-30bf-4050-b4f6-2dc580616f80" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-0a1101e5-30bf-4050-b4f6-2dc580616f80" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Deleting offline snapshot 0a1101e5-30bf-4050-b4f6-2dc580616f80 of volume f62c4f51-6605-4e31-942d-637fc68c53e4 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:25:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] snapshot_file for this snap is: volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:25:36 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89298c1-e33c-4766-a150-45badaa092a7]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:36 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80 Jul 23 22:25:36 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:37 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8acbd7ea-e534-4086-a1a8-e354fecdefe5" returned: 0 in 0.553s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.522s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1627070c-23fa-4911-a30b-057b86e7a02b,created_at=2026-07-23T20:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1848671791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1627070c-23fa-4911-a30b-057b86e7a02b,host='devstack@QuobyteHD#QuobyteHD',id=caf45567-75a5-4d2a-a5a6-52f65be10d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e952acc4f54672864a8e4e6401153f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:35Z,use_quota=True,user_id='a8bf68ebf5ba41a38a7381ca7a4af22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49b42d1b-2be8-4082-a300-8399139c06d7),volume_type_id=49b42d1b-2be8-4082-a300-8399139c06d7)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Creating volume caf45567-75a5-4d2a-a5a6-52f65be10d2f {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:25:37 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-caf45567-75a5-4d2a-a5a6-52f65be10d2f 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:37 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-caf45567-75a5-4d2a-a5a6-52f65be10d2f 1073741824 Jul 23 22:25:37 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa05d81d-3a13-4b70-9729-a337861910b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8acbd7ea-e534-4086-a1a8-e354fecdefe5', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a457ad81-ec5b-42c8-92be-e9ff2177fc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:37 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Volume volume-8acbd7ea-e534-4086-a1a8-e354fecdefe5 (8acbd7ea-e534-4086-a1a8-e354fecdefe5): created successfully Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a457ad81-ec5b-42c8-92be-e9ff2177fc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Flow 'volume_create_manager' (e59a877b-af83-4ea5-b81b-7551707f191f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:37 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-fe0e16c9-eaa2-4da0-8ca9-46b704eb1680 tempest-VolumesActionsTest-883193912 None] Created volume successfully. Jul 23 22:25:37 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80" returned: 0 in 0.616s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f62c4f51-6605-4e31-942d-637fc68c53e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c2fe45-cfd2-4455-b8d4-cd10e014b1a6]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:37 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4 Jul 23 22:25:37 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Acquiring lock "cinder-8acbd7ea-e534-4086-a1a8-e354fecdefe5-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-8acbd7ea-e534-4086-a1a8-e354fecdefe5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Acquiring lock "cinder-quobyte-8acbd7ea-e534-4086-a1a8-e354fecdefe5" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-quobyte-8acbd7ea-e534-4086-a1a8-e354fecdefe5" acquired by "delete_volume" :: waited 0.033s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:37 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-caf45567-75a5-4d2a-a5a6-52f65be10d2f 1073741824" returned: 0 in 0.695s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bdc0a5-4a0a-4974-989e-a3822c59647f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8acbd7ea-e534-4086-a1a8-e354fecdefe5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:37 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-caf45567-75a5-4d2a-a5a6-52f65be10d2f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4" returned: 0 in 0.547s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:38 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-caf45567-75a5-4d2a-a5a6-52f65be10d2f Jul 23 22:25:38 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:38 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80 Jul 23 22:25:38 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:38 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8acbd7ea-e534-4086-a1a8-e354fecdefe5 Jul 23 22:25:38 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:38 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-caf45567-75a5-4d2a-a5a6-52f65be10d2f" returned: 0 in 0.460s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c594bc72-69f6-4a84-bdd0-3cc6122305be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caf45567-75a5-4d2a-a5a6-52f65be10d2f', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49dcdf87-94aa-4b83-b466-1101b115516a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:38 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Volume volume-caf45567-75a5-4d2a-a5a6-52f65be10d2f (caf45567-75a5-4d2a-a5a6-52f65be10d2f): created successfully Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49dcdf87-94aa-4b83-b466-1101b115516a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Flow 'volume_create_manager' (75a1b1d1-b93e-4654-86b4-ce023e625221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:38 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f6a33460-88a5-4e7f-baa3-4a2d0d7ae3dd tempest-GroupsTest-911798911 None] Created volume successfully. Jul 23 22:25:38 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8acbd7ea-e534-4086-a1a8-e354fecdefe5" returned: 0 in 0.674s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8acbd7ea-e534-4086-a1a8-e354fecdefe5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:38 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:38 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8acbd7ea-e534-4086-a1a8-e354fecdefe5 Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80" returned: 0 in 0.610s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:38 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:38 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80 Jul 23 22:25:38 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:38 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8acbd7ea-e534-4086-a1a8-e354fecdefe5" returned: 0 in 0.319s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-quobyte-8acbd7ea-e534-4086-a1a8-e354fecdefe5" released by "delete_volume" :: held 1.066s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:38 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4.0a1101e5-30bf-4050-b4f6-2dc580616f80" returned: 0 in 0.313s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-0a1101e5-30bf-4050-b4f6-2dc580616f80" released by "_delete_snapshot" :: held 2.247s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-f62c4f51-6605-4e31-942d-637fc68c53e4" released by "delete_snapshot" :: held 2.288s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "cinder-quobyte-4a64b206-9cb7-4150-a713-736b9df37274" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Created reservations ['4fa85840-4916-40fe-8076-69147c1977b3', '33752ea7-f7e4-4ada-9f0d-2c2de28a8183', 'dd8f3b4d-a6e1-46e9-a7fa-98b40fc138c4', 'd70e1a09-d87b-4a3a-a691-01f6ff208513'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-4a64b206-9cb7-4150-a713-736b9df37274" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "cinder-quobyte-ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Deleting offline snapshot ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd of volume 4a64b206-9cb7-4150-a713-736b9df37274 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] snapshot_file for this snap is: volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85d7bc7-0292-452c-92ac-ac743876af19]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:39 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:25:39 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:39 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd Jul 23 22:25:39 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:39 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.339s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:39 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Deleted volume successfully. Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b8d3a47d-0b34-4cb6-8004-99ca550b41d4 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-8acbd7ea-e534-4086-a1a8-e354fecdefe5-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:39 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd" returned: 0 in 0.526s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a64b206-9cb7-4150-a713-736b9df37274(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[466786b9-0ba3-4a1e-b1c6-321e5365a12f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:39 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274 Jul 23 22:25:39 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Acquiring lock "cinder-quobyte-caf45567-75a5-4d2a-a5a6-52f65be10d2f" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Lock "cinder-quobyte-caf45567-75a5-4d2a-a5a6-52f65be10d2f" acquired by "delete_volume" :: waited 0.030s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:40 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b53a18c-7a16-4d2d-a317-5ee9cc206dec]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-caf45567-75a5-4d2a-a5a6-52f65be10d2f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:40 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274" returned: 0 in 0.540s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:40 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd Jul 23 22:25:40 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:40 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-caf45567-75a5-4d2a-a5a6-52f65be10d2f Jul 23 22:25:40 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:40 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-caf45567-75a5-4d2a-a5a6-52f65be10d2f" returned: 0 in 0.550s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-caf45567-75a5-4d2a-a5a6-52f65be10d2f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:40 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-caf45567-75a5-4d2a-a5a6-52f65be10d2f Jul 23 22:25:40 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:40 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd" returned: 0 in 0.714s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:40 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd Jul 23 22:25:40 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Flow 'volume_create_manager' (e1b32bb1-2fdf-4b76-8f6f-8e7025807e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50349b1b-cf7c-4cd6-9edc-97c286c21a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50349b1b-cf7c-4cd6-9edc-97c286c21a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1816237682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8346e4d9-86cf-48a9-8784-aeed43fe9ef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430dd24b3d5d49eaad405a5ad66000c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:41Z,use_quota=True,user_id='29b3048bf3d64a2a9b3f1d8a335eb74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0bfc5f0-3fcc-49ff-934e-52bbb6ea2f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0bfc5f0-3fcc-49ff-934e-52bbb6ea2f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2181384d-8dfc-4f23-9ffb-98101e99d135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2181384d-8dfc-4f23-9ffb-98101e99d135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8346e4d9-86cf-48a9-8784-aeed43fe9ef9', 'volume_name': 'volume-8346e4d9-86cf-48a9-8784-aeed43fe9ef9', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f845ed1-897e-4824-977a-f4bedb98fdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f845ed1-897e-4824-977a-f4bedb98fdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:41 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d8aaa1-4462-49ac-afd2-ff4fa689d02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:41 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Volume 8346e4d9-86cf-48a9-8784-aeed43fe9ef9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8346e4d9-86cf-48a9-8784-aeed43fe9ef9', 'volume_size': 1} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1816237682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8346e4d9-86cf-48a9-8784-aeed43fe9ef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430dd24b3d5d49eaad405a5ad66000c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:41Z,use_quota=True,user_id='29b3048bf3d64a2a9b3f1d8a335eb74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Creating volume 8346e4d9-86cf-48a9-8784-aeed43fe9ef9 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:25:41 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8346e4d9-86cf-48a9-8784-aeed43fe9ef9 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-caf45567-75a5-4d2a-a5a6-52f65be10d2f" returned: 0 in 0.587s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:41 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8346e4d9-86cf-48a9-8784-aeed43fe9ef9 1073741824 Jul 23 22:25:41 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Lock "cinder-quobyte-caf45567-75a5-4d2a-a5a6-52f65be10d2f" released by "delete_volume" :: held 1.227s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Created reservations ['da547e25-8de9-4563-b449-9f9ac9b91771'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:41 devstack cinder-volume[88308]: WARNING cinder.quota [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-84456475 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-84456475, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:25:41 devstack cinder-volume[88308]: WARNING cinder.quota [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-84456475 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-84456475, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:25:41 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274.ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd" returned: 0 in 0.632s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-ee7e0ee9-6ed9-4946-a9db-ec2eb22764cd" released by "_delete_snapshot" :: held 2.581s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Created reservations ['cd0aef09-7c3c-4364-b8a8-6d09b9d2b9d3', '84179d4e-1d4a-42a8-9bc2-e3f616391814', '4b05b444-7a01-4889-bad9-8d60c2d9f226', 'daeea216-3325-4078-921f-6178ccc5d221'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-4a64b206-9cb7-4150-a713-736b9df37274" released by "delete_snapshot" :: held 2.644s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:41 devstack cinder-volume[88308]: WARNING cinder.quota [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-91831123 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-91831123, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:25:41 devstack cinder-volume[88308]: WARNING cinder.quota [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-91831123 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-91831123, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Created reservations ['8a106907-281c-4496-974a-25111e90e884', 'f8248c65-c7a7-4764-a9ae-a73afa07c765', '382d3274-fdf0-4229-ae09-8dac413b0639', 'c28b6ce7-2dff-4cb3-8b00-1c0fcbcd7622'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:42 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:25:42 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:42 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8346e4d9-86cf-48a9-8784-aeed43fe9ef9 1073741824" returned: 0 in 0.914s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8346e4d9-86cf-48a9-8784-aeed43fe9ef9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:42 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8346e4d9-86cf-48a9-8784-aeed43fe9ef9 Jul 23 22:25:42 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] Created reservations ['e0c4e4bc-9bfe-4cc0-9fb0-b87852485542', 'e4db5c2c-a992-4c20-bd77-53fc61240391', '64b033a7-5a42-4689-adf3-decfccfb99ac', 'e8c518d6-1718-4903-aec5-df3e4920dc69'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:42 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2ac918dc-a0b5-4943-92c1-bf7f31d24374 tempest-GroupSnapshotsTest-1247013327 None] group_snapshot 73eff34e-ee47-4e16-a4da-74d776fcab29: deleted successfully Jul 23 22:25:42 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.391s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:42 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-69240ed4-874a-45ca-851a-eb9c285ea99c tempest-GroupsTest-911798911 None] Delete group completed successfully. Jul 23 22:25:42 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8346e4d9-86cf-48a9-8784-aeed43fe9ef9" returned: 0 in 0.377s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d8aaa1-4462-49ac-afd2-ff4fa689d02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8346e4d9-86cf-48a9-8784-aeed43fe9ef9', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40fbc6eb-c533-4565-bcee-9073f44e9db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:42 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Volume volume-8346e4d9-86cf-48a9-8784-aeed43fe9ef9 (8346e4d9-86cf-48a9-8784-aeed43fe9ef9): created successfully Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40fbc6eb-c533-4565-bcee-9073f44e9db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Flow 'volume_create_manager' (e1b32bb1-2fdf-4b76-8f6f-8e7025807e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:42 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e54be53c-0a95-422c-9558-47c6693f23e6 tempest-VolumesActionsTest-883193912 None] Created volume successfully. Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "cinder-quobyte-4a64b206-9cb7-4150-a713-736b9df37274" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-4a64b206-9cb7-4150-a713-736b9df37274" acquired by "delete_volume" :: waited 0.045s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5809b2a5-77d5-4fca-bc96-49c43411c4f3]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-e634b306-3459-4aef-ab1b-f48fe002dde4 tempest-GroupsTest-911798911 None] Created reservations ['41f85421-9895-489c-8358-62a4a65cde55'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Acquiring lock "cinder-8346e4d9-86cf-48a9-8784-aeed43fe9ef9-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-8346e4d9-86cf-48a9-8784-aeed43fe9ef9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e634b306-3459-4aef-ab1b-f48fe002dde4 tempest-GroupsTest-911798911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e634b306-3459-4aef-ab1b-f48fe002dde4 tempest-GroupsTest-911798911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e634b306-3459-4aef-ab1b-f48fe002dde4 tempest-GroupsTest-911798911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e634b306-3459-4aef-ab1b-f48fe002dde4 tempest-GroupsTest-911798911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e634b306-3459-4aef-ab1b-f48fe002dde4 tempest-GroupsTest-911798911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e634b306-3459-4aef-ab1b-f48fe002dde4 tempest-GroupsTest-911798911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:43 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274 Jul 23 22:25:43 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:43 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:25:43 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Acquiring lock "cinder-quobyte-8346e4d9-86cf-48a9-8784-aeed43fe9ef9" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-quobyte-8346e4d9-86cf-48a9-8784-aeed43fe9ef9" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca42c1ae-e65c-4d1f-a270-7d2df2d5e548]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8346e4d9-86cf-48a9-8784-aeed43fe9ef9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:43 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8346e4d9-86cf-48a9-8784-aeed43fe9ef9 Jul 23 22:25:43 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:43 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e634b306-3459-4aef-ab1b-f48fe002dde4 tempest-GroupsTest-911798911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.293s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-e634b306-3459-4aef-ab1b-f48fe002dde4 tempest-GroupsTest-911798911 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:43 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e634b306-3459-4aef-ab1b-f48fe002dde4 tempest-GroupsTest-911798911 None] Delete group completed successfully. Jul 23 22:25:43 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274" returned: 0 in 0.493s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:43 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274 Jul 23 22:25:43 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:43 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8346e4d9-86cf-48a9-8784-aeed43fe9ef9" returned: 0 in 0.492s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8346e4d9-86cf-48a9-8784-aeed43fe9ef9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:43 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8346e4d9-86cf-48a9-8784-aeed43fe9ef9 Jul 23 22:25:43 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:44 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4a64b206-9cb7-4150-a713-736b9df37274" returned: 0 in 0.417s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-4a64b206-9cb7-4150-a713-736b9df37274" released by "delete_volume" :: held 1.010s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "cinder-quobyte-f62c4f51-6605-4e31-942d-637fc68c53e4" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-f62c4f51-6605-4e31-942d-637fc68c53e4" acquired by "delete_volume" :: waited 0.050s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c055d6-90e7-4c8b-96d1-5677d6acf17a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:44 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8346e4d9-86cf-48a9-8784-aeed43fe9ef9" returned: 0 in 0.406s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-quobyte-8346e4d9-86cf-48a9-8784-aeed43fe9ef9" released by "delete_volume" :: held 0.971s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Created reservations ['664010dd-6ca1-4a48-8b82-fb4964c10bbb', 'e4a78096-e39b-4382-89de-dfe3af995a23', '25244a4b-5f44-42e1-9a21-c0dca2efd27e', '9bc67312-86e9-4945-80b3-dc5c4cc72a31'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:44 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4 Jul 23 22:25:44 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:44 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:25:44 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:44 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.301s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:44 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Deleted volume successfully. Jul 23 22:25:44 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4" returned: 0 in 0.652s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c32ef8ed-7452-45ab-8373-93b1835d1ab5 tempest-VolumesActionsTest-1972611281 None] Lock "cinder-8346e4d9-86cf-48a9-8784-aeed43fe9ef9-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:44 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4 Jul 23 22:25:44 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:45 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-900c395e-0cae-4a6e-a05f-71dd5818a224 tempest-GroupsTest-911798911 None] Group tempest-GroupsTest-Group-56494543: creating Jul 23 22:25:45 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-900c395e-0cae-4a6e-a05f-71dd5818a224 tempest-GroupsTest-911798911 None] Group tempest-GroupsTest-Group-56494543: created successfully Jul 23 22:25:45 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-900c395e-0cae-4a6e-a05f-71dd5818a224 tempest-GroupsTest-911798911 None] Create group completed successfully. Jul 23 22:25:45 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f62c4f51-6605-4e31-942d-637fc68c53e4" returned: 0 in 0.301s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-f62c4f51-6605-4e31-942d-637fc68c53e4" released by "delete_volume" :: held 1.060s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:45 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Created reservations ['b1c75375-dc10-4cda-a7f0-47769ba8cf15'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:45 devstack cinder-volume[88308]: WARNING cinder.quota [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-91831123 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-91831123, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:25:45 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Created reservations ['a73f5c93-fb82-40bd-809e-bbdb50be18cc', 'd0e3435f-c1ba-4349-b3f8-ea8418529906', 'a0facd03-408d-40ea-bde4-3db2839dbb58', 'efdf0a6c-1e28-4e6e-b0c6-af049621aef8'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:45 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Created reservations ['46ad0912-0285-4fda-a7a3-843abd8282e7', '63b900b4-46c6-4428-81bd-fcdd7de17ece', '884556fe-e715-4514-b769-e4d684c833f5', 'ee36a9be-5775-43d8-8f2e-c4d8b119c9d3'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:45 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:25:45 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:45 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.328s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:45 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:45 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f9831cbe-39a3-4d54-9627-efe84c16fbe2 tempest-GroupSnapshotsTest-1247013327 None] Delete group completed successfully. Jul 23 22:25:46 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-466298ec-c394-493d-8480-a594d6974d21 tempest-GroupSnapshotsTest-1247013327 None] Group tempest-GroupSnapshotsTest-Group-473808462: creating Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Flow 'volume_create_manager' (603a56c2-e965-44b1-a5b5-bbcf5993548c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f450f3-faee-481b-b3fa-02741feb6924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f450f3-faee-481b-b3fa-02741feb6924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1377166954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209986ba-bbec-4ae6-8903-233fba46d26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430dd24b3d5d49eaad405a5ad66000c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:47Z,use_quota=True,user_id='29b3048bf3d64a2a9b3f1d8a335eb74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18dcfe50-693c-4b79-9b12-8960b9185e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18dcfe50-693c-4b79-9b12-8960b9185e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd902e3-91d5-4e15-98c1-50c89f56bef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd902e3-91d5-4e15-98c1-50c89f56bef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209986ba-bbec-4ae6-8903-233fba46d26d', 'volume_name': 'volume-209986ba-bbec-4ae6-8903-233fba46d26d', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a279b0-ff97-4e39-a82f-31a6bc076b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a279b0-ff97-4e39-a82f-31a6bc076b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ca8545-44a2-4a00-81db-8012f68c67e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:46 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Volume 209986ba-bbec-4ae6-8903-233fba46d26d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209986ba-bbec-4ae6-8903-233fba46d26d', 'volume_size': 1} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1377166954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209986ba-bbec-4ae6-8903-233fba46d26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430dd24b3d5d49eaad405a5ad66000c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:47Z,use_quota=True,user_id='29b3048bf3d64a2a9b3f1d8a335eb74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Creating volume 209986ba-bbec-4ae6-8903-233fba46d26d {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:25:46 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:25:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-209986ba-bbec-4ae6-8903-233fba46d26d 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:46 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-209986ba-bbec-4ae6-8903-233fba46d26d 1073741824 Jul 23 22:25:46 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:46 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-466298ec-c394-493d-8480-a594d6974d21 tempest-GroupSnapshotsTest-1247013327 None] Group tempest-GroupSnapshotsTest-Group-473808462: created successfully Jul 23 22:25:46 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-466298ec-c394-493d-8480-a594d6974d21 tempest-GroupSnapshotsTest-1247013327 None] Create group completed successfully. Jul 23 22:25:47 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:25:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Flow 'volume_create_manager' (93ab2a4c-3a32-45d3-b459-a673f93c350d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fefa13-a182-42a5-b2b1-f9a71b29b0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fefa13-a182-42a5-b2b1-f9a71b29b0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1755601434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e7df7d6-6d44-4d01-b96a-d2436892b9ec,host='devstack@QuobyteHD#QuobyteHD',id=23dcff49-289b-41a5-bfa3-fa992c1c26d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e952acc4f54672864a8e4e6401153f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:47Z,use_quota=True,user_id='a8bf68ebf5ba41a38a7381ca7a4af22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ef5259d-e82e-4525-9f9a-29d2c5544758),volume_type_id=4ef5259d-e82e-4525-9f9a-29d2c5544758)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1985898e-33ba-4e60-8759-b9e3f0d03c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1985898e-33ba-4e60-8759-b9e3f0d03c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d383006-ba04-4d6d-b112-691c98c65be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d383006-ba04-4d6d-b112-691c98c65be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23dcff49-289b-41a5-bfa3-fa992c1c26d7', 'volume_name': 'volume-23dcff49-289b-41a5-bfa3-fa992c1c26d7', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34fb5ef-c691-4a44-acef-84bc0fe6bd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34fb5ef-c691-4a44-acef-84bc0fe6bd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffa8905-81a8-48bd-bfac-92d8ff8a1fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:47 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Volume 23dcff49-289b-41a5-bfa3-fa992c1c26d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23dcff49-289b-41a5-bfa3-fa992c1c26d7', 'volume_size': 1} Jul 23 22:25:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:47 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-209986ba-bbec-4ae6-8903-233fba46d26d 1073741824" returned: 0 in 0.825s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-209986ba-bbec-4ae6-8903-233fba46d26d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:47 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-209986ba-bbec-4ae6-8903-233fba46d26d Jul 23 22:25:47 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:48 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-209986ba-bbec-4ae6-8903-233fba46d26d" returned: 0 in 0.328s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.660s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8e7df7d6-6d44-4d01-b96a-d2436892b9ec,created_at=2026-07-23T20:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1755601434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e7df7d6-6d44-4d01-b96a-d2436892b9ec,host='devstack@QuobyteHD#QuobyteHD',id=23dcff49-289b-41a5-bfa3-fa992c1c26d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e952acc4f54672864a8e4e6401153f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:47Z,use_quota=True,user_id='a8bf68ebf5ba41a38a7381ca7a4af22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ef5259d-e82e-4525-9f9a-29d2c5544758),volume_type_id=4ef5259d-e82e-4525-9f9a-29d2c5544758)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Creating volume 23dcff49-289b-41a5-bfa3-fa992c1c26d7 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:25:48 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-23dcff49-289b-41a5-bfa3-fa992c1c26d7 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ca8545-44a2-4a00-81db-8012f68c67e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209986ba-bbec-4ae6-8903-233fba46d26d', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:48 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-23dcff49-289b-41a5-bfa3-fa992c1c26d7 1073741824 Jul 23 22:25:48 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e39f3c2-af41-43be-b554-3de2b6e25602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:48 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Volume volume-209986ba-bbec-4ae6-8903-233fba46d26d (209986ba-bbec-4ae6-8903-233fba46d26d): created successfully Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e39f3c2-af41-43be-b554-3de2b6e25602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Flow 'volume_create_manager' (603a56c2-e965-44b1-a5b5-bbcf5993548c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:48 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-7b7ef321-9841-47c5-9ac1-4223fe363e40 tempest-VolumesActionsTest-883193912 None] Created volume successfully. Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Flow 'volume_create_manager' (4ae30465-c537-4db7-bd81-c978b0950b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eaddca6-8f9d-4563-857d-cfc6e689f9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eaddca6-8f9d-4563-857d-cfc6e689f9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-371000456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60e92a88-05f4-4985-aa3b-1ad35ad1eee3,host='devstack@QuobyteHD#QuobyteHD',id=1a8e0316-0507-4c6a-a97c-b970a5dec2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7893fc2bfdf74a1189a29ea49fffe54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:48Z,use_quota=True,user_id='6b6b0471606d4d8cbd4ffff133c42b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9aaca4c-ead2-439f-9596-22f24f1bf9a9),volume_type_id=d9aaca4c-ead2-439f-9596-22f24f1bf9a9)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec04a97-cf23-453a-abea-be6890b9adde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec04a97-cf23-453a-abea-be6890b9adde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e1dfec-0e46-4a2e-929c-2e3c5f9891e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e1dfec-0e46-4a2e-929c-2e3c5f9891e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a8e0316-0507-4c6a-a97c-b970a5dec2d7', 'volume_name': 'volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25547c01-7291-44ff-b6e8-9d8a1ddd6ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25547c01-7291-44ff-b6e8-9d8a1ddd6ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09aa7da-4d2c-45b7-8fe6-0edc37c87eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:48 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Volume 1a8e0316-0507-4c6a-a97c-b970a5dec2d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7', 'volume_size': 1} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:48 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-23dcff49-289b-41a5-bfa3-fa992c1c26d7 1073741824" returned: 0 in 0.779s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-23dcff49-289b-41a5-bfa3-fa992c1c26d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:48 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-23dcff49-289b-41a5-bfa3-fa992c1c26d7 Jul 23 22:25:48 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:49 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-23dcff49-289b-41a5-bfa3-fa992c1c26d7" returned: 0 in 0.290s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=60e92a88-05f4-4985-aa3b-1ad35ad1eee3,created_at=2026-07-23T20:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-371000456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60e92a88-05f4-4985-aa3b-1ad35ad1eee3,host='devstack@QuobyteHD#QuobyteHD',id=1a8e0316-0507-4c6a-a97c-b970a5dec2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7893fc2bfdf74a1189a29ea49fffe54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:48Z,use_quota=True,user_id='6b6b0471606d4d8cbd4ffff133c42b95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9aaca4c-ead2-439f-9596-22f24f1bf9a9),volume_type_id=d9aaca4c-ead2-439f-9596-22f24f1bf9a9)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Creating volume 1a8e0316-0507-4c6a-a97c-b970a5dec2d7 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:25:49 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffa8905-81a8-48bd-bfac-92d8ff8a1fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23dcff49-289b-41a5-bfa3-fa992c1c26d7', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc717fd-8d37-4967-9165-a88ad69b277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:49 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 1073741824 Jul 23 22:25:49 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:49 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Volume volume-23dcff49-289b-41a5-bfa3-fa992c1c26d7 (23dcff49-289b-41a5-bfa3-fa992c1c26d7): created successfully Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc717fd-8d37-4967-9165-a88ad69b277f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Flow 'volume_create_manager' (93ab2a4c-3a32-45d3-b459-a673f93c350d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:49 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-515b7d9b-ec15-4c4f-a910-7d332d06cee2 tempest-GroupsTest-911798911 None] Created volume successfully. Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Acquiring lock "cinder-209986ba-bbec-4ae6-8903-233fba46d26d-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:49 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Lock "cinder-209986ba-bbec-4ae6-8903-233fba46d26d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 1073741824" returned: 0 in 0.506s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Acquiring lock "cinder-quobyte-209986ba-bbec-4ae6-8903-233fba46d26d" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:49 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 Jul 23 22:25:49 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Lock "cinder-quobyte-209986ba-bbec-4ae6-8903-233fba46d26d" acquired by "delete_volume" :: waited 0.035s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8f541f-6df8-4855-8c10-8a61b8cb709b]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-209986ba-bbec-4ae6-8903-233fba46d26d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:50 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-209986ba-bbec-4ae6-8903-233fba46d26d Jul 23 22:25:50 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:50 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7" returned: 0 in 0.411s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09aa7da-4d2c-45b7-8fe6-0edc37c87eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a07f069-0b82-45d2-b8f0-af038c599bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:50 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Volume volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 (1a8e0316-0507-4c6a-a97c-b970a5dec2d7): created successfully Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a07f069-0b82-45d2-b8f0-af038c599bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Flow 'volume_create_manager' (4ae30465-c537-4db7-bd81-c978b0950b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:50 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-803f1b2b-e1e6-43d7-a493-16f054fba745 tempest-GroupSnapshotsTest-1247013327 None] Created volume successfully. Jul 23 22:25:50 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-209986ba-bbec-4ae6-8903-233fba46d26d" returned: 0 in 0.579s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-209986ba-bbec-4ae6-8903-233fba46d26d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:25:50 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-209986ba-bbec-4ae6-8903-233fba46d26d Jul 23 22:25:50 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Flow 'volume_create_manager' (507fb1db-9a56-4e51-92ff-a6e9ce7126a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f727a85f-27a2-4387-b0cc-b3d62154a10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f727a85f-27a2-4387-b0cc-b3d62154a10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1116825339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e7df7d6-6d44-4d01-b96a-d2436892b9ec,host='devstack@QuobyteHD#QuobyteHD',id=230d3e66-919f-4b9d-b4c1-762abba01c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e952acc4f54672864a8e4e6401153f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:50Z,use_quota=True,user_id='a8bf68ebf5ba41a38a7381ca7a4af22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ef5259d-e82e-4525-9f9a-29d2c5544758),volume_type_id=4ef5259d-e82e-4525-9f9a-29d2c5544758)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4421284c-caac-4aba-a21f-eb1761e786f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4421284c-caac-4aba-a21f-eb1761e786f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae36b22-a929-4c7a-9516-4e1580aad0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae36b22-a929-4c7a-9516-4e1580aad0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '230d3e66-919f-4b9d-b4c1-762abba01c66', 'volume_name': 'volume-230d3e66-919f-4b9d-b4c1-762abba01c66', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97b514a-5bb5-40bb-bdee-594f8dcbc7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97b514a-5bb5-40bb-bdee-594f8dcbc7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccc6c10-90f3-4e1d-8098-1ef9d9a6e8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:50 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Volume 230d3e66-919f-4b9d-b4c1-762abba01c66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-230d3e66-919f-4b9d-b4c1-762abba01c66', 'volume_size': 1} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8e7df7d6-6d44-4d01-b96a-d2436892b9ec,created_at=2026-07-23T20:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1116825339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e7df7d6-6d44-4d01-b96a-d2436892b9ec,host='devstack@QuobyteHD#QuobyteHD',id=230d3e66-919f-4b9d-b4c1-762abba01c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e952acc4f54672864a8e4e6401153f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:25:50Z,use_quota=True,user_id='a8bf68ebf5ba41a38a7381ca7a4af22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ef5259d-e82e-4525-9f9a-29d2c5544758),volume_type_id=4ef5259d-e82e-4525-9f9a-29d2c5544758)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Creating volume 230d3e66-919f-4b9d-b4c1-762abba01c66 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:25:50 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-230d3e66-919f-4b9d-b4c1-762abba01c66 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:50 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-230d3e66-919f-4b9d-b4c1-762abba01c66 1073741824 Jul 23 22:25:50 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:50 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-209986ba-bbec-4ae6-8903-233fba46d26d" returned: 0 in 0.313s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Lock "cinder-quobyte-209986ba-bbec-4ae6-8903-233fba46d26d" released by "delete_volume" :: held 0.942s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=210,cinder:UPDATE=207,cinder:INSERT=43,cinder:DELETE=9 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=180,cinder:UPDATE=222,cinder:DELETE=12,cinder:INSERT=54 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Created reservations ['a24c26ac-0238-48de-b97d-b8c103a53a82', '18df3c75-2cf9-41b2-9ec8-c2d530448bc7', '009befb0-4889-4726-ae4a-005e8c6913b0', '12478606-9fc2-448d-91e8-5bd93c540717'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:50 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:25:50 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:51 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-230d3e66-919f-4b9d-b4c1-762abba01c66 1073741824" returned: 0 in 0.511s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-230d3e66-919f-4b9d-b4c1-762abba01c66 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:51 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-230d3e66-919f-4b9d-b4c1-762abba01c66 Jul 23 22:25:51 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:51 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.307s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:51 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Deleted volume successfully. Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4192fbf0-b6a5-4332-a5c4-0676894b3ece tempest-VolumesActionsTest-883193912 None] Lock "cinder-209986ba-bbec-4ae6-8903-233fba46d26d-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:51 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-230d3e66-919f-4b9d-b4c1-762abba01c66" returned: 0 in 0.298s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccc6c10-90f3-4e1d-8098-1ef9d9a6e8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-230d3e66-919f-4b9d-b4c1-762abba01c66', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb98349d-bace-4796-8e60-912e63570dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:25:51 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Volume volume-230d3e66-919f-4b9d-b4c1-762abba01c66 (230d3e66-919f-4b9d-b4c1-762abba01c66): created successfully Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb98349d-bace-4796-8e60-912e63570dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Flow 'volume_create_manager' (507fb1db-9a56-4e51-92ff-a6e9ce7126a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:25:51 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a2d17c42-eaf1-4bb8-9788-77afb77a8805 tempest-GroupsTest-911798911 None] Created volume successfully. Jul 23 22:25:51 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] GroupSnapshot 9800734e-acb8-4e4d-a4cd-b7f7950b2243: creating. Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] Group snapshot 9800734e-acb8-4e4d-a4cd-b7f7950b2243: creating. {{(pid=88308) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] Creating offline snapshot 2b753dac-e3b5-4d28-9e00-f423d12714f3 of volume 1a8e0316-0507-4c6a-a97c-b970a5dec2d7 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d3d9cd-bcfa-4d83-999f-285be23897c6]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:51 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 Jul 23 22:25:51 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:51 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b7cacdea-0fa9-45ad-924f-5b2a897c16dc tempest-GroupsTest-911798911 None] Update group completed successfully. Jul 23 22:25:51 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7" returned: 0 in 0.421s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:52 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3 1G Jul 23 22:25:52 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:52 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3 1G" returned: 0 in 0.468s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:52 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3 Jul 23 22:25:52 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:52 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3" returned: 0 in 0.360s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:52 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 22:25:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:52 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3 Jul 23 22:25:52 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:53 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3" returned: 0 in 0.398s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:53 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6f8b859c-bb45-41dc-be22-2f158f6a8502 tempest-GroupsTest-911798911 None] Update group completed successfully. Jul 23 22:25:53 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.info Jul 23 22:25:53 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:53 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.info" returned: 0 in 0.315s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:53 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 22:25:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:53 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.info Jul 23 22:25:53 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:53 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.info" returned: 0 in 0.265s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:53 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-5df5a02d-434a-40f2-ba09-ff63945e1afd tempest-GroupSnapshotsTest-1247013327 None] group_snapshot 9800734e-acb8-4e4d-a4cd-b7f7950b2243: created successfully Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Acquiring lock "cinder-quobyte-230d3e66-919f-4b9d-b4c1-762abba01c66" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Lock "cinder-quobyte-230d3e66-919f-4b9d-b4c1-762abba01c66" acquired by "delete_volume" :: waited 0.042s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:55 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] group_snapshot 9800734e-acb8-4e4d-a4cd-b7f7950b2243: deleting Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[404d890c-ed40-4b56-bf6e-85e86fc894aa]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-230d3e66-919f-4b9d-b4c1-762abba01c66 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] group_snapshot 9800734e-acb8-4e4d-a4cd-b7f7950b2243: deleting {{(pid=88308) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "cinder-quobyte-1a8e0316-0507-4c6a-a97c-b970a5dec2d7" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-1a8e0316-0507-4c6a-a97c-b970a5dec2d7" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "cinder-quobyte-2b753dac-e3b5-4d28-9e00-f423d12714f3" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-2b753dac-e3b5-4d28-9e00-f423d12714f3" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] Deleting offline snapshot 2b753dac-e3b5-4d28-9e00-f423d12714f3 of volume 1a8e0316-0507-4c6a-a97c-b970a5dec2d7 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] snapshot_file for this snap is: volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17a98df-bb3a-48cb-9042-40db6dc636f1]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:55 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-230d3e66-919f-4b9d-b4c1-762abba01c66 Jul 23 22:25:55 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:55 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3 Jul 23 22:25:55 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:55 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-230d3e66-919f-4b9d-b4c1-762abba01c66" returned: 0 in 0.605s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-230d3e66-919f-4b9d-b4c1-762abba01c66 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:55 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-230d3e66-919f-4b9d-b4c1-762abba01c66 Jul 23 22:25:55 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:55 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3" returned: 0 in 0.473s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[15793260-81b7-4133-9d4b-726cc29a5b52]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:56 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 Jul 23 22:25:56 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:56 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-230d3e66-919f-4b9d-b4c1-762abba01c66" returned: 0 in 0.337s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Lock "cinder-quobyte-230d3e66-919f-4b9d-b4c1-762abba01c66" released by "delete_volume" :: held 1.020s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Acquiring lock "cinder-quobyte-23dcff49-289b-41a5-bfa3-fa992c1c26d7" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Lock "cinder-quobyte-23dcff49-289b-41a5-bfa3-fa992c1c26d7" acquired by "delete_volume" :: waited 0.029s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:56 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f5e9e5-857f-46cd-8a7d-8badb096086e]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-23dcff49-289b-41a5-bfa3-fa992c1c26d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:56 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-23dcff49-289b-41a5-bfa3-fa992c1c26d7 Jul 23 22:25:56 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:56 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7" returned: 0 in 0.730s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:56 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3 Jul 23 22:25:56 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:56 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-23dcff49-289b-41a5-bfa3-fa992c1c26d7" returned: 0 in 0.584s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-23dcff49-289b-41a5-bfa3-fa992c1c26d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:56 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-23dcff49-289b-41a5-bfa3-fa992c1c26d7 Jul 23 22:25:56 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:56 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3" returned: 0 in 0.376s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:57 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3 Jul 23 22:25:57 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:57 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-23dcff49-289b-41a5-bfa3-fa992c1c26d7" returned: 0 in 0.260s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Lock "cinder-quobyte-23dcff49-289b-41a5-bfa3-fa992c1c26d7" released by "delete_volume" :: held 0.911s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Created reservations ['93ca02f6-172d-4062-a47d-6f01a3a42458'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:57 devstack cinder-volume[88308]: WARNING cinder.quota [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1981199046 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1981199046, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:25:57 devstack cinder-volume[88308]: WARNING cinder.quota [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1981199046 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1981199046, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Created reservations ['09480f80-1c88-4c94-b78f-da7eeb0c138f', '407df381-c1cb-440c-b65d-afd44103bf2c', 'ae5d2e93-cf12-4891-ae2c-484d2e1220ae', 'ccdd142e-0fed-4924-92af-5f5fa3f020f2'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:57 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7.2b753dac-e3b5-4d28-9e00-f423d12714f3" returned: 0 in 0.278s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-2b753dac-e3b5-4d28-9e00-f423d12714f3" released by "_delete_snapshot" :: held 2.002s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-1a8e0316-0507-4c6a-a97c-b970a5dec2d7" released by "delete_snapshot" :: held 2.048s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Created reservations ['1b62408d-408d-4cc7-9c29-8185c3f3c592', 'c191436f-47cc-432f-9c23-36559a49be49', 'afb1f5a0-75cb-4372-a0b4-334b46693150', '9465ffbe-3227-4ec7-b7a7-ff326ae3b176'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:57 devstack cinder-volume[88308]: WARNING cinder.quota [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2139795295 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2139795295, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:25:57 devstack cinder-volume[88308]: WARNING cinder.quota [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2139795295 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2139795295, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] Created reservations ['fe82d258-1c4c-448b-ba26-742eb9ac7afc', '3a7a0d46-18da-4417-aad6-fb9eec8361ad', '2f6147fc-c73b-4c5c-9541-86524a917f49', 'cfef1c9b-1e48-4b9d-88f7-0b6fb62c70b5'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:57 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:25:57 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:57 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b7844bf2-25b3-47df-95ca-8b7c3b36c06f tempest-GroupSnapshotsTest-1247013327 None] group_snapshot 9800734e-acb8-4e4d-a4cd-b7f7950b2243: deleted successfully Jul 23 22:25:57 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.278s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:57 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:25:57 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-5d6b0ce8-c348-4625-a3c1-942e67d9ca8f tempest-GroupsTest-911798911 None] Delete group completed successfully. Jul 23 22:25:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "cinder-quobyte-1a8e0316-0507-4c6a-a97c-b970a5dec2d7" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:25:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-1a8e0316-0507-4c6a-a97c-b970a5dec2d7" acquired by "delete_volume" :: waited 0.025s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:25:59 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ca209e-0e8f-42f9-937f-06911b5c3ec2]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:25:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:59 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 Jul 23 22:25:59 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:59 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7" returned: 0 in 0.442s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:25:59 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7 Jul 23 22:25:59 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:25:59 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 23 22:25:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1a8e0316-0507-4c6a-a97c-b970a5dec2d7" returned: 0 in 0.325s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:25:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] Lock "cinder-quobyte-1a8e0316-0507-4c6a-a97c-b970a5dec2d7" released by "delete_volume" :: held 0.921s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:25:59 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] Created reservations ['33f05da8-665e-4b6d-a1a5-9fd0d3531dae'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:25:59 devstack cinder-volume[88308]: WARNING cinder.quota [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2139795295 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2139795295, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:26:00 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] Created reservations ['d57df75a-4ea8-444b-b0ca-7bab05d1f744', 'cbb286ff-1e5c-422c-81f6-23661b81a89e', '4a0d43d8-2715-4675-b625-ef9bc16e0c9f', '9869eca0-4ffd-4f35-a78e-d3b9b853a044'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:00 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:26:00 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:00 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.294s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:00 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:26:00 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-83e929df-341e-404b-b132-28629aa69813 tempest-GroupSnapshotsTest-1247013327 None] Delete group completed successfully. Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Flow 'volume_create_manager' (7eeceb1c-5754-4189-b08c-75d1fee21d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd09999-cd55-49ac-ba10-53a186cbad7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd09999-cd55-49ac-ba10-53a186cbad7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1976438507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef43c0e-9842-4b33-8642-a77823a8085d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dead2518534c9cb61f78e56e025e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:06Z,use_quota=True,user_id='98adb02c13a947fc820cb635eaf222fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12246a95-eac0-4d85-8ca7-92ca4f864b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12246a95-eac0-4d85-8ca7-92ca4f864b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41723762-0fde-42cf-a8b3-c3e69efeea72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41723762-0fde-42cf-a8b3-c3e69efeea72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef43c0e-9842-4b33-8642-a77823a8085d', 'volume_name': 'volume-8ef43c0e-9842-4b33-8642-a77823a8085d', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f74b1b-0b01-4a83-9f99-814ec49379a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f74b1b-0b01-4a83-9f99-814ec49379a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991d8855-fb76-4ca8-a0e2-ca4a50eb72f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:05 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Volume 8ef43c0e-9842-4b33-8642-a77823a8085d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef43c0e-9842-4b33-8642-a77823a8085d', 'volume_size': 1} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1976438507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef43c0e-9842-4b33-8642-a77823a8085d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30dead2518534c9cb61f78e56e025e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:06Z,use_quota=True,user_id='98adb02c13a947fc820cb635eaf222fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Creating volume 8ef43c0e-9842-4b33-8642-a77823a8085d {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:26:05 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:26:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:05 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d 1073741824 Jul 23 22:26:05 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Flow 'volume_create_manager' (c5236c8f-c034-42dc-b1f4-0777bf9c0fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b069b0b-a16b-4eb6-b5e1-e3e6801aa9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b069b0b-a16b-4eb6-b5e1-e3e6801aa9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1409447824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cff1252-9656-4c84-b660-24b2b1a5de53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7731543e154c5d9cf80e713d6a837d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:06Z,use_quota=True,user_id='79368f37c112440e8e03fb35c8fa337a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c55d1b1-ef69-4e1f-a96e-83cb90446415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c55d1b1-ef69-4e1f-a96e-83cb90446415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bc55ad-54ea-4d66-b9a2-a8c332aab01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.image.glance [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Creating Keystone auth plugin from conf {{(pid=88308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 22:26:06 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d 1073741824" returned: 0 in 0.517s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:06 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d Jul 23 22:26:06 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:06 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d" returned: 0 in 0.271s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991d8855-fb76-4ca8-a0e2-ca4a50eb72f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef43c0e-9842-4b33-8642-a77823a8085d', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1664724-bae0-488c-a194-4a2a6874e9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:06 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Volume volume-8ef43c0e-9842-4b33-8642-a77823a8085d (8ef43c0e-9842-4b33-8642-a77823a8085d): created successfully Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1664724-bae0-488c-a194-4a2a6874e9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Flow 'volume_create_manager' (7eeceb1c-5754-4189-b08c-75d1fee21d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:06 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c52460f6-def6-4e45-9305-787c34e77b60 tempest-SnapshotsActionsTest-246532653 None] Created volume successfully. Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bc55ad-54ea-4d66-b9a2-a8c332aab01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3cff1252-9656-4c84-b660-24b2b1a5de53', 'volume_name': 'volume-3cff1252-9656-4c84-b660-24b2b1a5de53', 'volume_size': 1, 'image_id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73edeb14970041b0969b3a5428a796ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'created_at': datetime.datetime(2026, 7, 23, 20, 14, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79e9d1bf-6470-4134-adab-55462317ad8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59530f2-4417-42f4-a105-66d1eb535dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59530f2-4417-42f4-a105-66d1eb535dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7548daf-ae67-47fd-9211-b61b001a7eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:06 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Volume 3cff1252-9656-4c84-b660-24b2b1a5de53: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3cff1252-9656-4c84-b660-24b2b1a5de53', 'volume_size': 1, 'image_id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73edeb14970041b0969b3a5428a796ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'created_at': datetime.datetime(2026, 7, 23, 20, 14, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79e9d1bf-6470-4134-adab-55462317ad8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 22:26:06 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Trying to clone 3cff1252-9656-4c84-b660-24b2b1a5de53 from image 79e9d1bf-6470-4134-adab-55462317ad8b at location (None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}]). {{(pid=88308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_ow48147kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 22:26:07 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Image download 20.69 MB at 20.69 MB/s Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c124f6a-5131-4c1f-acf2-0fcf27a029b9]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_ow48147kdevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:07 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_ow48147kdevstack@QuobyteHD Jul 23 22:26:07 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:07 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_ow48147kdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Temporary image 79e9d1bf-6470-4134-adab-55462317ad8b is fetched for user 79368f37c112440e8e03fb35c8fa337a. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Flow 'volume_create_manager' (f5037427-79b4-41b4-bf44-e1b048d2eba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fd0ec4-824c-488b-a1dd-fa3de647c60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dc36de-49f3-43cc-9383-5b92b3afcf90]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_ow48147kdevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fd0ec4-824c-488b-a1dd-fa3de647c60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-345050750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66965df715f468cabd95bed46d8b01e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:08Z,use_quota=True,user_id='50d81bff5eeb43728af8641f16b77916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a886b5-b07d-4a62-8f50-acf3061d8731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a886b5-b07d-4a62-8f50-acf3061d8731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002e44bb-43d2-4c3a-a569-d87833d37156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002e44bb-43d2-4c3a-a569-d87833d37156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67', 'volume_name': 'volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92e8932-361f-4f5d-b8de-40203da61c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92e8932-361f-4f5d-b8de-40203da61c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99bcda9-3dcb-4614-9f6c-af561fae90dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:07 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Volume 9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67', 'volume_size': 1} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-345050750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66965df715f468cabd95bed46d8b01e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:08Z,use_quota=True,user_id='50d81bff5eeb43728af8641f16b77916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Creating volume 9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:26:07 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:26:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:08 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67 1073741824 Jul 23 22:26:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:08 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:08 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_ow48147kdevstack@QuobyteHD Jul 23 22:26:08 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:08 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f4b4bf40-c162-47ab-ab72-6af6a67c86f5 tempest-GroupsV314Test-523999877 None] Group tempest-GroupsV314Test-Group-133291824: creating Jul 23 22:26:08 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f4b4bf40-c162-47ab-ab72-6af6a67c86f5 tempest-GroupsV314Test-523999877 None] Group tempest-GroupsV314Test-Group-133291824: created successfully Jul 23 22:26:08 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f4b4bf40-c162-47ab-ab72-6af6a67c86f5 tempest-GroupsV314Test-523999877 None] Create group completed successfully. Jul 23 22:26:08 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_ow48147kdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:08 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67 1073741824" returned: 0 in 0.468s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:08 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67 Jul 23 22:26:08 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:08 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67" returned: 0 in 0.247s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:08 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:26:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.705s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99bcda9-3dcb-4614-9f6c-af561fae90dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf21a87-fd85-42bf-b281-8c5535467481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:08 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] Creating offline snapshot 6b0026c2-255c-4842-a84e-484018038acb of volume 8ef43c0e-9842-4b33-8642-a77823a8085d {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:26:08 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Volume volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67 (9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67): created successfully Jul 23 22:26:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf21a87-fd85-42bf-b281-8c5535467481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Flow 'volume_create_manager' (f5037427-79b4-41b4-bf44-e1b048d2eba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:08 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8e158a-6daa-42b4-a3d3-63cbf847a55a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:08 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-09227bf1-7d72-4e38-a117-9d05977f3901 tempest-AttachVolumeNegativeTest-577220995 None] Created volume successfully. Jul 23 22:26:08 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d Jul 23 22:26:08 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:09 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d" returned: 0 in 0.368s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:09 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb 1G Jul 23 22:26:09 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:09 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb 1G" returned: 0 in 0.413s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef43c0e-9842-4b33-8642-a77823a8085d -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:09 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef43c0e-9842-4b33-8642-a77823a8085d -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb Jul 23 22:26:09 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Flow 'volume_create_manager' (4c0d77f1-ce97-4bd8-856c-de78549e95d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ef8975-d8eb-45af-a6c2-bec7defd72f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ef8975-d8eb-45af-a6c2-bec7defd72f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1329156747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b10ef1ea-d188-401d-86d0-4ab2c0bbd6f4,host='devstack@QuobyteHD#QuobyteHD',id=d730f269-0754-4652-a814-4288426a5739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed75cd822834358b3d802f39660c2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:10Z,use_quota=True,user_id='5263f0cd3db6473086780c6dd845c26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14384b54-9d45-498f-ba89-932ed5bd8f8a),volume_type_id=14384b54-9d45-498f-ba89-932ed5bd8f8a)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4c55bb-8682-42b7-b652-8ffa0bdddf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4c55bb-8682-42b7-b652-8ffa0bdddf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5921f9d7-aa90-4290-a51e-0ded88300662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5921f9d7-aa90-4290-a51e-0ded88300662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd730f269-0754-4652-a814-4288426a5739', 'volume_name': 'volume-d730f269-0754-4652-a814-4288426a5739', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:09 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999c1fb1-3d09-467e-8900-168306d8369a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999c1fb1-3d09-467e-8900-168306d8369a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b22c1b-48cf-4c5a-b76c-d0a430d0a2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:09 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Volume d730f269-0754-4652-a814-4288426a5739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d730f269-0754-4652-a814-4288426a5739', 'volume_size': 1} Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef43c0e-9842-4b33-8642-a77823a8085d -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb" returned: 0 in 0.345s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:09 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb is being set with open permissions: ugo+rw Jul 23 22:26:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:09 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb Jul 23 22:26:09 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:10 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb" returned: 0 in 0.263s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:10 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.info Jul 23 22:26:10 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:10 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.info" returned: 0 in 0.266s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:10 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.info is being set with open permissions: ugo+rw Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:10 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.info Jul 23 22:26:10 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-2f54a17f-b961-4579-b9a8-037f09b39b1c req-97c1e894-a705-4bd8-a1c9-b61bb1ac8b52 tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:10 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.info" returned: 0 in 0.253s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.465s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1409447824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cff1252-9656-4c84-b660-24b2b1a5de53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7731543e154c5d9cf80e713d6a837d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:06Z,use_quota=True,user_id='79368f37c112440e8e03fb35c8fa337a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Creating volume 3cff1252-9656-4c84-b660-24b2b1a5de53 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:26:10 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:26:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:10 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 1073741824 Jul 23 22:26:10 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:10 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-5610c9f2-026a-4941-aff3-4a7144148f61 tempest-SnapshotsActionsTest-246532653 None] Create snapshot completed successfully Jul 23 22:26:11 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 1073741824" returned: 0 in 0.457s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:11 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 Jul 23 22:26:11 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:11 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53" returned: 0 in 0.252s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.603s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b10ef1ea-d188-401d-86d0-4ab2c0bbd6f4,created_at=2026-07-23T20:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1329156747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b10ef1ea-d188-401d-86d0-4ab2c0bbd6f4,host='devstack@QuobyteHD#QuobyteHD',id=d730f269-0754-4652-a814-4288426a5739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed75cd822834358b3d802f39660c2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:10Z,use_quota=True,user_id='5263f0cd3db6473086780c6dd845c26b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14384b54-9d45-498f-ba89-932ed5bd8f8a),volume_type_id=14384b54-9d45-498f-ba89-932ed5bd8f8a)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Creating volume d730f269-0754-4652-a814-4288426a5739 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:26:11 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:11 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 1073741824 Jul 23 22:26:11 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Attempting download of 79e9d1bf-6470-4134-adab-55462317ad8b ((None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}])) to volume 3cff1252-9656-4c84-b660-24b2b1a5de53. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd441aa-ee0b-433a-8213-ded7f8c2b079]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_yog9ckvp {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:11 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_yog9ckvp Jul 23 22:26:11 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7c6a1a67-c05b-451e-9991-b1ee8203a5de tempest-SnapshotsActionsTest-246532653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:12 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 1073741824" returned: 0 in 0.478s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:12 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_yog9ckvp" returned: 0 in 0.392s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_yog9ckvp {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:12 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 Jul 23 22:26:12 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:12 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_yog9ckvp Jul 23 22:26:12 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:12 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739" returned: 0 in 0.259s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-2f54a17f-b961-4579-b9a8-037f09b39b1c req-97c1e894-a705-4bd8-a1c9-b61bb1ac8b52 tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.714s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b22c1b-48cf-4c5a-b76c-d0a430d0a2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d730f269-0754-4652-a814-4288426a5739', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c26cfa-f1f7-48b4-9f31-70846c7b533f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b46798-aac5-4124-bc83-00a8ee726890]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-2f54a17f-b961-4579-b9a8-037f09b39b1c req-97c1e894-a705-4bd8-a1c9-b61bb1ac8b52 tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:12 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:12 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Volume volume-d730f269-0754-4652-a814-4288426a5739 (d730f269-0754-4652-a814-4288426a5739): created successfully Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c26cfa-f1f7-48b4-9f31-70846c7b533f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Flow 'volume_create_manager' (4c0d77f1-ce97-4bd8-856c-de78549e95d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_yog9ckvp" returned: 1 in 0.370s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_yog9ckvp' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7960db7-a2ba-44e6-9fb3-df8991ff7f8d]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_ow48147kdevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:12 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-d77822f5-9ba3-4c47-a355-d9beb1fa25fa tempest-GroupsV314Test-523999877 None] Created volume successfully. Jul 23 22:26:12 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67 Jul 23 22:26:12 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:12 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_ow48147kdevstack@QuobyteHD Jul 23 22:26:12 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:12 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-2f54a17f-b961-4579-b9a8-037f09b39b1c req-97c1e894-a705-4bd8-a1c9-b61bb1ac8b52 tempest-AttachVolumeNegativeTest-577220995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67" returned: 0 in 0.378s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-2f54a17f-b961-4579-b9a8-037f09b39b1c req-97c1e894-a705-4bd8-a1c9-b61bb1ac8b52 tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.409s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7c6a1a67-c05b-451e-9991-b1ee8203a5de tempest-SnapshotsActionsTest-246532653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.907s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:12 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_ow48147kdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] 79e9d1bf-6470-4134-adab-55462317ad8b was qcow2, converting to raw {{(pid=88308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_ow48147kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-7c6a1a67-c05b-451e-9991-b1ee8203a5de tempest-SnapshotsActionsTest-246532653 None] Creating offline snapshot 5c29ad2d-188a-456e-bf45-b13f04b30624 of volume 8ef43c0e-9842-4b33-8642-a77823a8085d {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:26:12 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_ow48147kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 Jul 23 22:26:12 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0517944-a304-4a15-b097-abfa32170584]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7c6a1a67-c05b-451e-9991-b1ee8203a5de tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-2f54a17f-b961-4579-b9a8-037f09b39b1c req-97c1e894-a705-4bd8-a1c9-b61bb1ac8b52 tempest-AttachVolumeNegativeTest-577220995 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '217f1f85-84f5-484b-9578-d0ac8e6ff5c2', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:26:12 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-2f54a17f-b961-4579-b9a8-037f09b39b1c req-97c1e894-a705-4bd8-a1c9-b61bb1ac8b52 tempest-AttachVolumeNegativeTest-577220995 None] attachment_update completed successfully. Jul 23 22:26:12 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb Jul 23 22:26:12 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:13 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7c6a1a67-c05b-451e-9991-b1ee8203a5de tempest-SnapshotsActionsTest-246532653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb" returned: 0 in 0.437s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-7c6a1a67-c05b-451e-9991-b1ee8203a5de tempest-SnapshotsActionsTest-246532653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef43c0e-9842-4b33-8642-a77823a8085d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:26:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7c6a1a67-c05b-451e-9991-b1ee8203a5de tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:13 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624 1G Jul 23 22:26:13 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:13 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7c6a1a67-c05b-451e-9991-b1ee8203a5de tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624 1G" returned: 0 in 0.612s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7c6a1a67-c05b-451e-9991-b1ee8203a5de tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:13 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624 Jul 23 22:26:13 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:14 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7c6a1a67-c05b-451e-9991-b1ee8203a5de tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624" returned: 0 in 0.427s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:14 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-7c6a1a67-c05b-451e-9991-b1ee8203a5de tempest-SnapshotsActionsTest-246532653 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624 is being set with open permissions: ugo+rw Jul 23 22:26:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7c6a1a67-c05b-451e-9991-b1ee8203a5de tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:14 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624 Jul 23 22:26:14 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:14 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7c6a1a67-c05b-451e-9991-b1ee8203a5de tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624" returned: 0 in 0.319s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:14 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7c6a1a67-c05b-451e-9991-b1ee8203a5de tempest-SnapshotsActionsTest-246532653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.409s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:14 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Cloning volume d730f269-0754-4652-a814-4288426a5739 to volume 8f3385cc-2f47-4566-92fb-4a3d050cd436 Jul 23 22:26:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_ow48147kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53" returned: 0 in 1.925s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:14 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_ow48147kdevstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:26:14 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Converted 112.00 MB image at 58.01 MB/s Jul 23 22:26:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:14 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 1G Jul 23 22:26:14 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:14 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Creating offline snapshot 09a71a06-0c15-4882-9430-9fd4a4ef76c2 of volume d730f269-0754-4652-a814-4288426a5739 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:26:14 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-7c6a1a67-c05b-451e-9991-b1ee8203a5de tempest-SnapshotsActionsTest-246532653 None] Create snapshot completed successfully Jul 23 22:26:14 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dac934b-2f01-4f03-b8d1-a7a857c9448b]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:14 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 Jul 23 22:26:14 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:15 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 1G" returned: 0 in 0.345s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d74eb53-f3f9-49c7-8199-7028d63f176a]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Acquiring lock "cinder-5c29ad2d-188a-456e-bf45-b13f04b30624-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-5c29ad2d-188a-456e-bf45-b13f04b30624-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Acquiring lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Acquiring lock "cinder-quobyte-5c29ad2d-188a-456e-bf45-b13f04b30624" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-quobyte-5c29ad2d-188a-456e-bf45-b13f04b30624" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Deleting offline snapshot 5c29ad2d-188a-456e-bf45-b13f04b30624 of volume 8ef43c0e-9842-4b33-8642-a77823a8085d {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:26:15 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] snapshot_file for this snap is: volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739" returned: 0 in 0.483s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f188878-7da5-4ffd-b39b-92140dee189b]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:15 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 Jul 23 22:26:15 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:15 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 1G Jul 23 22:26:15 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:15 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624 Jul 23 22:26:15 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:15 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53" returned: 0 in 0.416s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:15 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 Jul 23 22:26:15 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:15 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624" returned: 0 in 0.460s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef43c0e-9842-4b33-8642-a77823a8085d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[854f82aa-2e5c-4f4e-83b6-f21f994d89f6]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:15 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 1G" returned: 0 in 0.542s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d730f269-0754-4652-a814-4288426a5739 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:15 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d730f269-0754-4652-a814-4288426a5739 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 Jul 23 22:26:15 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:15 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb Jul 23 22:26:15 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:16 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53" returned: 1 in 0.518s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Downloaded image 79e9d1bf-6470-4134-adab-55462317ad8b ((None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}])) to volume 3cff1252-9656-4c84-b660-24b2b1a5de53 successfully. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Temporary image 79e9d1bf-6470-4134-adab-55462317ad8b for user 79368f37c112440e8e03fb35c8fa337a is deleted. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Marking volume 3cff1252-9656-4c84-b660-24b2b1a5de53 as bootable. {{(pid=88308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Copying metadata from image 79e9d1bf-6470-4134-adab-55462317ad8b to 3cff1252-9656-4c84-b660-24b2b1a5de53. {{(pid=88308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Creating volume glance metadata for volume 3cff1252-9656-4c84-b660-24b2b1a5de53 backed by image 79e9d1bf-6470-4134-adab-55462317ad8b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7548daf-ae67-47fd-9211-b61b001a7eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cff1252-9656-4c84-b660-24b2b1a5de53', 'volume_size': 1, 'image_id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73edeb14970041b0969b3a5428a796ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'created_at': datetime.datetime(2026, 7, 23, 20, 14, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79e9d1bf-6470-4134-adab-55462317ad8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ffc5b2-7f32-4e9f-884b-5b50c68ee665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:16 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:16 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Volume volume-3cff1252-9656-4c84-b660-24b2b1a5de53 (3cff1252-9656-4c84-b660-24b2b1a5de53): created successfully Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ffc5b2-7f32-4e9f-884b-5b50c68ee665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Flow 'volume_create_manager' (c5236c8f-c034-42dc-b1f4-0777bf9c0fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d730f269-0754-4652-a814-4288426a5739 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2" returned: 0 in 0.432s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:16 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:16 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-5317662d-6105-4801-9455-6ba457d514a1 tempest-VolumesImageMetadata-312286834 None] Created volume successfully. Jul 23 22:26:16 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb" returned: 0 in 0.490s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef43c0e-9842-4b33-8642-a77823a8085d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:16 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 Jul 23 22:26:16 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:16 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624 Jul 23 22:26:16 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:16 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2" returned: 0 in 0.280s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:16 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.info Jul 23 22:26:16 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:16 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624" returned: 0 in 0.436s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:16 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624 Jul 23 22:26:16 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:16 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.info" returned: 0 in 0.284s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:16 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.info is being set with open permissions: ugo+rw: NotImplementedError Jul 23 22:26:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:16 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.info Jul 23 22:26:16 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:17 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5c29ad2d-188a-456e-bf45-b13f04b30624" returned: 0 in 0.409s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-quobyte-5c29ad2d-188a-456e-bf45-b13f04b30624" released by "_delete_snapshot" :: held 1.933s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" released by "delete_snapshot" :: held 1.962s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:17 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.info" returned: 0 in 0.444s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Acquiring lock "cinder-quobyte-8f3385cc-2f47-4566-92fb-4a3d050cd436" by "_copy_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Created reservations ['c79b8a66-6418-4539-8d61-071f69412b0b', 'e92d38a0-bbd1-41c8-b545-e824fa3c1689', 'f0c01176-2b67-4fe0-9a0c-d4dff3ed3d82', 'e4877de7-939b-4abc-9bab-732655d044cc'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Lock "cinder-quobyte-8f3385cc-2f47-4566-92fb-4a3d050cd436" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] snapshot: 09a71a06-0c15-4882-9430-9fd4a4ef76c2, volume: 8f3385cc-2f47-4566-92fb-4a3d050cd436, {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bf7e41-5943-4722-80ff-12a73237a5dd]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:17 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Delete snapshot completed successfully. Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Acquiring lock "cinder-3cff1252-9656-4c84-b660-24b2b1a5de53-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6c98a9ee-fde1-4527-92e5-f51a8d1d7816 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-5c29ad2d-188a-456e-bf45-b13f04b30624-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Lock "cinder-3cff1252-9656-4c84-b660-24b2b1a5de53-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Acquiring lock "cinder-quobyte-3cff1252-9656-4c84-b660-24b2b1a5de53" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:17 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 Jul 23 22:26:17 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Lock "cinder-quobyte-3cff1252-9656-4c84-b660-24b2b1a5de53" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4994850-f67c-496d-a118-8ca2c53dcc66]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:17 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 Jul 23 22:26:17 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:17 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2" returned: 0 in 0.394s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d730f269-0754-4652-a814-4288426a5739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Creating direct copy from snapshot {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0eba66-3a2d-46e5-9da3-11f5d66c05db]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:17 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 Jul 23 22:26:17 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:17 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53" returned: 0 in 0.378s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:18 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 Jul 23 22:26:18 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:18 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739" returned: 0 in 0.422s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:18 devstack cinder-volume[88308]: DEBUG cinder.utils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Path /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f3385cc-2f47-4566-92fb-4a3d050cd436 not found in is_blk_device check {{(pid=88308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 22:26:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f3385cc-2f47-4566-92fb-4a3d050cd436 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:18 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f3385cc-2f47-4566-92fb-4a3d050cd436 Jul 23 22:26:18 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:18 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53" returned: 1 in 0.497s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:26:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:18 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53 Jul 23 22:26:18 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:18 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3cff1252-9656-4c84-b660-24b2b1a5de53" returned: 0 in 0.268s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Lock "cinder-quobyte-3cff1252-9656-4c84-b660-24b2b1a5de53" released by "delete_volume" :: held 1.215s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1140ec68-e55e-4dc8-9211-21ddd5816361 tempest-SnapshotsActionsTest-246532653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:18 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Created reservations ['cd9c28a9-44c7-4775-82ab-75347ced3ae5', 'a0a1489f-62b4-4406-84fa-a3165dc73e8d', 'b5ff9bb6-5e59-474c-af00-09c0ac88a93a', '8755e3d1-ad7a-42c9-a88e-4dadc22a523f'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:19 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:26:19 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:19 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.452s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:19 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:26:19 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Deleted volume successfully. Jul 23 22:26:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7cbc74d6-830a-42f0-bbef-f31c79280c13 tempest-VolumesImageMetadata-312286834 None] Lock "cinder-3cff1252-9656-4c84-b660-24b2b1a5de53-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f3385cc-2f47-4566-92fb-4a3d050cd436" returned: 0 in 6.264s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:24 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8500dcae-cc57-407c-ad77-a15f16b232fd]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:24 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 Jul 23 22:26:24 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:25 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739" returned: 0 in 0.623s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:25 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f3385cc-2f47-4566-92fb-4a3d050cd436 {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:26:25 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Converted 1024.00 MB image at 163.45 MB/s Jul 23 22:26:25 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f3385cc-2f47-4566-92fb-4a3d050cd436 is being set with open permissions: ugo+rw: NotImplementedError Jul 23 22:26:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f3385cc-2f47-4566-92fb-4a3d050cd436 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:25 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f3385cc-2f47-4566-92fb-4a3d050cd436 Jul 23 22:26:25 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:25 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f3385cc-2f47-4566-92fb-4a3d050cd436" returned: 0 in 0.317s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Lock "cinder-quobyte-8f3385cc-2f47-4566-92fb-4a3d050cd436" released by "_copy_volume_from_snapshot" :: held 8.129s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Acquiring lock "cinder-quobyte-09a71a06-0c15-4882-9430-9fd4a4ef76c2" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Lock "cinder-quobyte-09a71a06-0c15-4882-9430-9fd4a4ef76c2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Deleting offline snapshot 09a71a06-0c15-4882-9430-9fd4a4ef76c2 of volume d730f269-0754-4652-a814-4288426a5739 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:26:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] snapshot_file for this snap is: volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:26:25 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dae294b-bfa9-4a28-998b-3c1daff57aff]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:25 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 Jul 23 22:26:25 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:26 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2" returned: 0 in 0.457s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d730f269-0754-4652-a814-4288426a5739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b7217c-4524-4043-9d61-134b6da28ea7]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:26 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:26:26 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Flow 'volume_create_manager' (53e20736-ad61-49e4-b0bf-bb102bfe1bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c09ca66a-5e1e-4193-a836-7c2a4673b1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c09ca66a-5e1e-4193-a836-7c2a4673b1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-605788350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1023d5c-5573-4f3b-929a-3a0e17b34d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d205f510eb4442897fe232488eb0b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:26Z,use_quota=True,user_id='65266361ce6d461fbd41611389244674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688ed954-27e2-4609-b432-e52c511a8800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688ed954-27e2-4609-b432-e52c511a8800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d3b815-cd58-43fa-9b78-003904290faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d3b815-cd58-43fa-9b78-003904290faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1023d5c-5573-4f3b-929a-3a0e17b34d78', 'volume_name': 'volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb90fdf-8816-4134-8e6b-7274a136aa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb90fdf-8816-4134-8e6b-7274a136aa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:26 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 Jul 23 22:26:26 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0842ab46-31e5-4d71-9ad9-b3d6d266658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:26 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Volume f1023d5c-5573-4f3b-929a-3a0e17b34d78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78', 'volume_size': 1} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:26 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.274s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 28 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:26:26 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739" returned: 0 in 0.392s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:26 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 Jul 23 22:26:26 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:27 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2" returned: 0 in 0.638s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:27 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2 Jul 23 22:26:27 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:27 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739.09a71a06-0c15-4882-9430-9fd4a4ef76c2" returned: 0 in 0.357s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Lock "cinder-quobyte-09a71a06-0c15-4882-9430-9fd4a4ef76c2" released by "_delete_snapshot" :: held 2.002s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.829s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1140ec68-e55e-4dc8-9211-21ddd5816361 tempest-SnapshotsActionsTest-246532653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.733s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-1140ec68-e55e-4dc8-9211-21ddd5816361 tempest-SnapshotsActionsTest-246532653 None] Creating offline snapshot a9aab1a6-d851-45db-9bfb-247de16b923d of volume 8ef43c0e-9842-4b33-8642-a77823a8085d {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:26:27 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d037e717-606e-4ef0-bdf6-b07d189503d9]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1140ec68-e55e-4dc8-9211-21ddd5816361 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:27 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-1e44759a-444f-45aa-b08d-77a2abaa4a59 tempest-GroupsV314Test-523999877 None] Create group from source-group-b10ef1ea-d188-401d-86d0-4ab2c0bbd6f4 completed successfully. Jul 23 22:26:27 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb Jul 23 22:26:27 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:28 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1140ec68-e55e-4dc8-9211-21ddd5816361 tempest-SnapshotsActionsTest-246532653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb" returned: 0 in 0.399s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:28 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-1140ec68-e55e-4dc8-9211-21ddd5816361 tempest-SnapshotsActionsTest-246532653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef43c0e-9842-4b33-8642-a77823a8085d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:26:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1140ec68-e55e-4dc8-9211-21ddd5816361 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:28 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d 1G Jul 23 22:26:28 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Acquiring lock "cinder-quobyte-8f3385cc-2f47-4566-92fb-4a3d050cd436" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Lock "cinder-quobyte-8f3385cc-2f47-4566-92fb-4a3d050cd436" acquired by "delete_volume" :: waited 0.035s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:28 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53d5017-5661-459d-ba05-b6ada5780491]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f3385cc-2f47-4566-92fb-4a3d050cd436 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:28 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1140ec68-e55e-4dc8-9211-21ddd5816361 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d 1G" returned: 0 in 0.628s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1140ec68-e55e-4dc8-9211-21ddd5816361 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:28 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d Jul 23 22:26:28 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:28 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f3385cc-2f47-4566-92fb-4a3d050cd436 Jul 23 22:26:28 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:29 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1140ec68-e55e-4dc8-9211-21ddd5816361 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d" returned: 0 in 0.373s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:29 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-1140ec68-e55e-4dc8-9211-21ddd5816361 tempest-SnapshotsActionsTest-246532653 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d is being set with open permissions: ugo+rw Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1140ec68-e55e-4dc8-9211-21ddd5816361 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:29 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f3385cc-2f47-4566-92fb-4a3d050cd436" returned: 0 in 0.518s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f3385cc-2f47-4566-92fb-4a3d050cd436 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:29 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d Jul 23 22:26:29 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:29 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f3385cc-2f47-4566-92fb-4a3d050cd436 Jul 23 22:26:29 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:29 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f3385cc-2f47-4566-92fb-4a3d050cd436" returned: 0 in 0.376s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:29 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1140ec68-e55e-4dc8-9211-21ddd5816361 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d" returned: 0 in 0.435s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Lock "cinder-quobyte-8f3385cc-2f47-4566-92fb-4a3d050cd436" released by "delete_volume" :: held 0.964s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1140ec68-e55e-4dc8-9211-21ddd5816361 tempest-SnapshotsActionsTest-246532653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.971s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.280s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-605788350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1023d5c-5573-4f3b-929a-3a0e17b34d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d205f510eb4442897fe232488eb0b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:26Z,use_quota=True,user_id='65266361ce6d461fbd41611389244674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Creating volume f1023d5c-5573-4f3b-929a-3a0e17b34d78 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:26:29 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:29 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 1073741824 Jul 23 22:26:29 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:29 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-1140ec68-e55e-4dc8-9211-21ddd5816361 tempest-SnapshotsActionsTest-246532653 None] Create snapshot completed successfully Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Created reservations ['d0016be8-f6be-4445-8490-ac9c4b563e26'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:29 devstack cinder-volume[88308]: WARNING cinder.quota [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1415117162 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1415117162, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:26:29 devstack cinder-volume[88308]: WARNING cinder.quota [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1415117162 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1415117162, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Created reservations ['1a6d3507-75a4-4c12-87c6-f04d365eea3b', '1ce41d4e-6b1a-46a0-8035-90abfa92f472', 'c87e5434-b779-4e88-a38c-7cd936ff0559', '5bbd6da7-61b7-4597-9828-d5789ab5c426'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:29 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:26:29 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:30 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.307s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:26:30 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-3673f49b-b2cf-40b4-aee3-b5248e791794 tempest-GroupsV314Test-523999877 None] Delete group completed successfully. Jul 23 22:26:30 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 1073741824" returned: 0 in 0.635s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:30 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 Jul 23 22:26:30 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:30 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78" returned: 0 in 0.319s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0842ab46-31e5-4d71-9ad9-b3d6d266658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a794662-26c8-4fcf-becf-6b6bd6456faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:30 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Volume volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 (f1023d5c-5573-4f3b-929a-3a0e17b34d78): created successfully Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a794662-26c8-4fcf-becf-6b6bd6456faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Flow 'volume_create_manager' (53e20736-ad61-49e4-b0bf-bb102bfe1bb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:30 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-1b3e4b02-1efd-460e-aaf4-b59fde18996d tempest-SnapshotMetadataTestJSON-825993913 None] Created volume successfully. Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Acquiring lock "cinder-a9aab1a6-d851-45db-9bfb-247de16b923d-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-a9aab1a6-d851-45db-9bfb-247de16b923d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Acquiring lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Acquiring lock "cinder-quobyte-a9aab1a6-d851-45db-9bfb-247de16b923d" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-quobyte-a9aab1a6-d851-45db-9bfb-247de16b923d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Deleting offline snapshot a9aab1a6-d851-45db-9bfb-247de16b923d of volume 8ef43c0e-9842-4b33-8642-a77823a8085d {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] snapshot_file for this snap is: volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9e35b6-6de7-446a-9a05-8e4df39e109c]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:31 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d Jul 23 22:26:31 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] Acquiring lock "cinder-quobyte-d730f269-0754-4652-a814-4288426a5739" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] Lock "cinder-quobyte-d730f269-0754-4652-a814-4288426a5739" acquired by "delete_volume" :: waited 0.031s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:31 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62dc2b3-3f3c-4a0d-9fc4-bcec6a45f361]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:31 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 Jul 23 22:26:31 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:31 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d" returned: 0 in 0.837s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef43c0e-9842-4b33-8642-a77823a8085d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:26:31 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dfb5eb-17c2-4711-a5c3-86e2c7fa08d2]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] Creating offline snapshot 03c3d595-57fb-4dab-a480-57e957b47590 of volume f1023d5c-5573-4f3b-929a-3a0e17b34d78 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:26:31 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcb3e66-bbb3-4901-adea-ebfac19a2bba]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:32 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb Jul 23 22:26:32 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:32 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739" returned: 0 in 0.724s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:32 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739 Jul 23 22:26:32 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:32 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 Jul 23 22:26:32 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:32 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d730f269-0754-4652-a814-4288426a5739" returned: 0 in 0.315s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:32 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb" returned: 0 in 0.635s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef43c0e-9842-4b33-8642-a77823a8085d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:26:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:32 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] Lock "cinder-quobyte-d730f269-0754-4652-a814-4288426a5739" released by "delete_volume" :: held 1.169s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:32 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d Jul 23 22:26:32 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:32 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] Created reservations ['4699199a-9734-40ec-a6b0-17465abee901'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:32 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78" returned: 0 in 0.661s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:32 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590 1G Jul 23 22:26:32 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:32 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] Created reservations ['f864fd4b-1ed0-4d74-9799-d8b0d53ae603', '7cd8b4fd-f8c1-468d-9de7-0492074384c9', '76dc1fb3-62b9-4c54-af38-d06ed46d230e', 'b462c1c6-253b-43f1-b0f3-340516cca55c'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:33 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:26:33 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:33 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d" returned: 0 in 0.667s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:33 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d Jul 23 22:26:33 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:33 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590 1G" returned: 0 in 0.581s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:33 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590 Jul 23 22:26:33 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:33 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.298s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:26:33 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-269aeff4-36a1-446f-986b-1f4bdc07bcf2 tempest-GroupsV314Test-523999877 None] Delete group completed successfully. Jul 23 22:26:33 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.a9aab1a6-d851-45db-9bfb-247de16b923d" returned: 0 in 0.274s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-quobyte-a9aab1a6-d851-45db-9bfb-247de16b923d" released by "_delete_snapshot" :: held 2.590s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" released by "delete_snapshot" :: held 2.629s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:33 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590" returned: 0 in 0.302s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:33 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590 is being set with open permissions: ugo+rw Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:33 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590 Jul 23 22:26:33 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Created reservations ['f330af4c-6fcf-4734-a7db-d38ac022e860', '956746f9-d3a8-4c25-91bd-f1fc7d99820b', '39dab163-5010-41ad-b338-44ed0be66073', '259a8eba-2f7c-4902-9f36-dddeb29249d3'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:33 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Delete snapshot completed successfully. Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-62b5532c-3d6e-49c7-a118-a1815637f7e0 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-a9aab1a6-d851-45db-9bfb-247de16b923d-delete_snapshot" released by "delete_snapshot" :: held 2.831s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:33 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590" returned: 0 in 0.258s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:33 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.info Jul 23 22:26:33 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:34 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.info" returned: 0 in 0.308s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:34 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.info is being set with open permissions: ugo+rw Jul 23 22:26:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:34 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.info Jul 23 22:26:34 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:34 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.info" returned: 0 in 0.273s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.515s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-914d45f0-d2f3-4a9d-8edf-97d15baa711e tempest-SnapshotsActionsTest-246532653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-914d45f0-d2f3-4a9d-8edf-97d15baa711e tempest-SnapshotsActionsTest-246532653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:34 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-d287a3b8-15e0-4224-92ac-645488f00589 tempest-SnapshotMetadataTestJSON-825993913 None] Create snapshot completed successfully Jul 23 22:26:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-914d45f0-d2f3-4a9d-8edf-97d15baa711e tempest-SnapshotsActionsTest-246532653 None] Creating offline snapshot 689cc92f-f7d4-4f09-a28b-9a0b970d7a10 of volume 8ef43c0e-9842-4b33-8642-a77823a8085d {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:26:34 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b024a1-caf1-4eb8-8aa8-63ddf1e598f5]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-914d45f0-d2f3-4a9d-8edf-97d15baa711e tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:34 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb Jul 23 22:26:34 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:35 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-914d45f0-d2f3-4a9d-8edf-97d15baa711e tempest-SnapshotsActionsTest-246532653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb" returned: 0 in 0.413s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-914d45f0-d2f3-4a9d-8edf-97d15baa711e tempest-SnapshotsActionsTest-246532653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef43c0e-9842-4b33-8642-a77823a8085d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:26:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-914d45f0-d2f3-4a9d-8edf-97d15baa711e tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:35 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10 1G Jul 23 22:26:35 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:35 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-914d45f0-d2f3-4a9d-8edf-97d15baa711e tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10 1G" returned: 0 in 0.597s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-914d45f0-d2f3-4a9d-8edf-97d15baa711e tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:35 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10 Jul 23 22:26:35 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Acquiring lock "cinder-03c3d595-57fb-4dab-a480-57e957b47590-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Lock "cinder-03c3d595-57fb-4dab-a480-57e957b47590-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Acquiring lock "cinder-quobyte-f1023d5c-5573-4f3b-929a-3a0e17b34d78" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:36 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-914d45f0-d2f3-4a9d-8edf-97d15baa711e tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10" returned: 0 in 0.508s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:36 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-914d45f0-d2f3-4a9d-8edf-97d15baa711e tempest-SnapshotsActionsTest-246532653 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10 is being set with open permissions: ugo+rw Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-914d45f0-d2f3-4a9d-8edf-97d15baa711e tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Lock "cinder-quobyte-f1023d5c-5573-4f3b-929a-3a0e17b34d78" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Acquiring lock "cinder-quobyte-03c3d595-57fb-4dab-a480-57e957b47590" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Lock "cinder-quobyte-03c3d595-57fb-4dab-a480-57e957b47590" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:36 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10 Jul 23 22:26:36 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Deleting offline snapshot 03c3d595-57fb-4dab-a480-57e957b47590 of volume f1023d5c-5573-4f3b-929a-3a0e17b34d78 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] snapshot_file for this snap is: volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3d91b2-cf00-452b-9ed1-15f7b7ee8944]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:36 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590 Jul 23 22:26:36 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:36 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-914d45f0-d2f3-4a9d-8edf-97d15baa711e tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10" returned: 0 in 0.359s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-914d45f0-d2f3-4a9d-8edf-97d15baa711e tempest-SnapshotsActionsTest-246532653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.021s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:36 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-914d45f0-d2f3-4a9d-8edf-97d15baa711e tempest-SnapshotsActionsTest-246532653 None] Create snapshot completed successfully Jul 23 22:26:36 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590" returned: 0 in 0.489s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[876bb04e-f881-46ab-9669-645ca5273614]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Acquiring lock "cinder-689cc92f-f7d4-4f09-a28b-9a0b970d7a10-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-689cc92f-f7d4-4f09-a28b-9a0b970d7a10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Acquiring lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Acquiring lock "cinder-quobyte-689cc92f-f7d4-4f09-a28b-9a0b970d7a10" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:36 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 Jul 23 22:26:36 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-quobyte-689cc92f-f7d4-4f09-a28b-9a0b970d7a10" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Deleting offline snapshot 689cc92f-f7d4-4f09-a28b-9a0b970d7a10 of volume 8ef43c0e-9842-4b33-8642-a77823a8085d {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:26:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] snapshot_file for this snap is: volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:26:37 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[766efb17-6c29-4e01-9d67-29f31d826bff]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:37 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10 Jul 23 22:26:37 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:37 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78" returned: 0 in 0.654s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:37 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590 Jul 23 22:26:37 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:37 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10" returned: 0 in 0.592s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef43c0e-9842-4b33-8642-a77823a8085d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:26:37 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88b8506-d306-4232-8c2c-e60c0f96f8df]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:37 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb Jul 23 22:26:37 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:37 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590" returned: 0 in 0.453s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:37 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590 Jul 23 22:26:37 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:38 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78.03c3d595-57fb-4dab-a480-57e957b47590" returned: 0 in 0.367s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:38 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb" returned: 0 in 0.563s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:38 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef43c0e-9842-4b33-8642-a77823a8085d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:26:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:38 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10 Jul 23 22:26:38 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Lock "cinder-quobyte-03c3d595-57fb-4dab-a480-57e957b47590" released by "_delete_snapshot" :: held 2.150s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Lock "cinder-quobyte-f1023d5c-5573-4f3b-929a-3a0e17b34d78" released by "delete_snapshot" :: held 2.194s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:38 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Created reservations ['14a293f2-9565-4a7f-8833-4401a0eee9c9', '33936423-b59d-4c56-b8d8-82861f5279f5', '8f0cf925-04b7-48f2-b939-fc3785e3ef85', '16460bda-3f62-4592-96e9-b724941db1b0'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:38 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Delete snapshot completed successfully. Jul 23 22:26:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-44146cc5-fa88-462f-bbbb-ca88207cf22c tempest-SnapshotMetadataTestJSON-825993913 None] Lock "cinder-03c3d595-57fb-4dab-a480-57e957b47590-delete_snapshot" released by "delete_snapshot" :: held 2.391s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:38 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10" returned: 0 in 0.486s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:38 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10 Jul 23 22:26:38 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:39 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.689cc92f-f7d4-4f09-a28b-9a0b970d7a10" returned: 0 in 0.280s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-quobyte-689cc92f-f7d4-4f09-a28b-9a0b970d7a10" released by "_delete_snapshot" :: held 2.063s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" released by "delete_snapshot" :: held 2.108s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:39 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Created reservations ['782a8f5a-5245-454b-9452-ba515c131845', '50983b7b-617f-47a8-8ddb-a9c020765560', 'd6b5c29d-9818-44a5-9d12-9feb61aeee0c', '33c0d0c3-17ea-45e4-adf3-08d5a47d20ef'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:39 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Delete snapshot completed successfully. Jul 23 22:26:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bfdde95-f970-4edd-996a-ede14aa81325 tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-689cc92f-f7d4-4f09-a28b-9a0b970d7a10-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Acquiring lock "cinder-f1023d5c-5573-4f3b-929a-3a0e17b34d78-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Lock "cinder-f1023d5c-5573-4f3b-929a-3a0e17b34d78-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Acquiring lock "cinder-quobyte-f1023d5c-5573-4f3b-929a-3a0e17b34d78" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Lock "cinder-quobyte-f1023d5c-5573-4f3b-929a-3a0e17b34d78" acquired by "delete_volume" :: waited 0.031s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:39 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5171d399-dce9-4804-b8d4-9efaf7be3b96]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:39 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 Jul 23 22:26:39 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:39 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78" returned: 0 in 0.413s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:39 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78 Jul 23 22:26:39 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:40 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f1023d5c-5573-4f3b-929a-3a0e17b34d78" returned: 0 in 0.277s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Lock "cinder-quobyte-f1023d5c-5573-4f3b-929a-3a0e17b34d78" released by "delete_volume" :: held 0.761s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:40 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Created reservations ['0cf35f23-ea93-49a3-b4de-b41d152c8ef7', 'ac2c2293-e0d0-4253-8b6e-dd519cb029ce', '2122f760-b08d-47cb-84d2-4383143517a6', '4b92bc1c-0ed8-433a-8814-00c872d20c08'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:40 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:26:40 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a24a6916-b3bc-438d-87b2-6ad685333cf8 tempest-SnapshotsActionsTest-246532653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a24a6916-b3bc-438d-87b2-6ad685333cf8 tempest-SnapshotsActionsTest-246532653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-a24a6916-b3bc-438d-87b2-6ad685333cf8 tempest-SnapshotsActionsTest-246532653 None] Creating offline snapshot 5f645aca-e91a-48af-9a32-3a1ddee1fad9 of volume 8ef43c0e-9842-4b33-8642-a77823a8085d {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:26:40 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[078d6df5-5f1c-4934-8f2a-e9b19528e87b]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a24a6916-b3bc-438d-87b2-6ad685333cf8 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:40 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb Jul 23 22:26:40 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:40 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.489s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:40 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:26:40 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Deleted volume successfully. Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de9049f9-82f7-46be-a7f3-b7437830c760 tempest-SnapshotMetadataTestJSON-825993913 None] Lock "cinder-f1023d5c-5573-4f3b-929a-3a0e17b34d78-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:41 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a24a6916-b3bc-438d-87b2-6ad685333cf8 tempest-SnapshotsActionsTest-246532653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb" returned: 0 in 0.599s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-a24a6916-b3bc-438d-87b2-6ad685333cf8 tempest-SnapshotsActionsTest-246532653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef43c0e-9842-4b33-8642-a77823a8085d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a24a6916-b3bc-438d-87b2-6ad685333cf8 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:41 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9 1G Jul 23 22:26:41 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Flow 'volume_create_manager' (fdc6033e-681e-4360-8109-bd0b59e5c3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ce8a22-ae1d-4ce4-8575-eb19af00cc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ce8a22-ae1d-4ce4-8575-eb19af00cc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-661024781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf27c35-7e40-4a81-adae-da3092b69d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd3b3ff524149e3aa0ffbc556c0ecae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:41Z,use_quota=True,user_id='e87221bb50dc4ce3aeeea173ead81560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7690c8f3-703f-42a9-8b4e-5e99367b1c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7690c8f3-703f-42a9-8b4e-5e99367b1c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf9c327-cce6-4700-b4f4-a9a6879b0a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf9c327-cce6-4700-b4f4-a9a6879b0a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaf27c35-7e40-4a81-adae-da3092b69d7b', 'volume_name': 'volume-eaf27c35-7e40-4a81-adae-da3092b69d7b', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962f7608-e717-4778-a5c2-eb3974a12278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962f7608-e717-4778-a5c2-eb3974a12278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533f152c-51c0-4aa6-a1d1-a6542eca6235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:41 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Volume eaf27c35-7e40-4a81-adae-da3092b69d7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaf27c35-7e40-4a81-adae-da3092b69d7b', 'volume_size': 1} Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:41 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a24a6916-b3bc-438d-87b2-6ad685333cf8 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9 1G" returned: 0 in 0.654s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a24a6916-b3bc-438d-87b2-6ad685333cf8 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:41 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9 Jul 23 22:26:41 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:42 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a24a6916-b3bc-438d-87b2-6ad685333cf8 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9" returned: 0 in 0.347s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:42 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-a24a6916-b3bc-438d-87b2-6ad685333cf8 tempest-SnapshotsActionsTest-246532653 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9 is being set with open permissions: ugo+rw Jul 23 22:26:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a24a6916-b3bc-438d-87b2-6ad685333cf8 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:42 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9 Jul 23 22:26:42 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:42 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a24a6916-b3bc-438d-87b2-6ad685333cf8 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9" returned: 0 in 0.270s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a24a6916-b3bc-438d-87b2-6ad685333cf8 tempest-SnapshotsActionsTest-246532653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.912s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-661024781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf27c35-7e40-4a81-adae-da3092b69d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd3b3ff524149e3aa0ffbc556c0ecae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:41Z,use_quota=True,user_id='e87221bb50dc4ce3aeeea173ead81560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:26:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Creating volume eaf27c35-7e40-4a81-adae-da3092b69d7b {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:26:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:26:42 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:26:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eaf27c35-7e40-4a81-adae-da3092b69d7b 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:42 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eaf27c35-7e40-4a81-adae-da3092b69d7b 1073741824 Jul 23 22:26:42 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:42 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a24a6916-b3bc-438d-87b2-6ad685333cf8 tempest-SnapshotsActionsTest-246532653 None] Create snapshot completed successfully Jul 23 22:26:43 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eaf27c35-7e40-4a81-adae-da3092b69d7b 1073741824" returned: 0 in 0.451s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eaf27c35-7e40-4a81-adae-da3092b69d7b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:43 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eaf27c35-7e40-4a81-adae-da3092b69d7b Jul 23 22:26:43 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:43 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eaf27c35-7e40-4a81-adae-da3092b69d7b" returned: 0 in 0.271s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533f152c-51c0-4aa6-a1d1-a6542eca6235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaf27c35-7e40-4a81-adae-da3092b69d7b', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a00c81b-d571-41fd-92fa-500b42325d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:43 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Volume volume-eaf27c35-7e40-4a81-adae-da3092b69d7b (eaf27c35-7e40-4a81-adae-da3092b69d7b): created successfully Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a00c81b-d571-41fd-92fa-500b42325d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Flow 'volume_create_manager' (fdc6033e-681e-4360-8109-bd0b59e5c3df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:43 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-bf5c306d-292d-4eff-a8d9-e0c92a7220cb tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Created volume successfully. Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Acquiring lock "cinder-5f645aca-e91a-48af-9a32-3a1ddee1fad9-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-5f645aca-e91a-48af-9a32-3a1ddee1fad9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Acquiring lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Acquiring lock "cinder-quobyte-5f645aca-e91a-48af-9a32-3a1ddee1fad9" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-quobyte-5f645aca-e91a-48af-9a32-3a1ddee1fad9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Deleting offline snapshot 5f645aca-e91a-48af-9a32-3a1ddee1fad9 of volume 8ef43c0e-9842-4b33-8642-a77823a8085d {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] snapshot_file for this snap is: volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[755307ee-800c-426d-9835-3b54e127651f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:44 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9 Jul 23 22:26:44 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:44 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9" returned: 0 in 0.468s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef43c0e-9842-4b33-8642-a77823a8085d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:26:44 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62f5d0e-56ea-4839-bca6-13bb6c5512c7]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:44 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb Jul 23 22:26:44 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Acquiring lock "cinder-eaf27c35-7e40-4a81-adae-da3092b69d7b-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Lock "cinder-eaf27c35-7e40-4a81-adae-da3092b69d7b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Acquiring lock "cinder-quobyte-eaf27c35-7e40-4a81-adae-da3092b69d7b" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Lock "cinder-quobyte-eaf27c35-7e40-4a81-adae-da3092b69d7b" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:44 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe664da-50ff-4384-94fd-55f5ac35f24f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eaf27c35-7e40-4a81-adae-da3092b69d7b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:44 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb" returned: 0 in 0.450s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef43c0e-9842-4b33-8642-a77823a8085d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:26:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:44 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9 Jul 23 22:26:44 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:44 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eaf27c35-7e40-4a81-adae-da3092b69d7b Jul 23 22:26:44 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:45 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eaf27c35-7e40-4a81-adae-da3092b69d7b" returned: 0 in 0.402s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eaf27c35-7e40-4a81-adae-da3092b69d7b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:45 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eaf27c35-7e40-4a81-adae-da3092b69d7b Jul 23 22:26:45 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:45 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9" returned: 0 in 0.467s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:45 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9 Jul 23 22:26:45 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:45 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-eaf27c35-7e40-4a81-adae-da3092b69d7b" returned: 0 in 0.271s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Lock "cinder-quobyte-eaf27c35-7e40-4a81-adae-da3092b69d7b" released by "delete_volume" :: held 0.721s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Created reservations ['0ebf105a-3f94-46b2-81f4-059a07c7c81f', 'f65c5be1-b53c-428f-a3fe-6aa05e884ec8', '19029116-8487-4b24-aa70-66e25eb4244f', '6d89983c-6c86-4116-a84a-6aa644930aa8'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:45 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.5f645aca-e91a-48af-9a32-3a1ddee1fad9" returned: 0 in 0.283s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-quobyte-5f645aca-e91a-48af-9a32-3a1ddee1fad9" released by "_delete_snapshot" :: held 1.779s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" released by "delete_snapshot" :: held 1.818s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:45 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:26:45 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Created reservations ['6293cf59-8ae3-44db-a0f6-bb208c283b2d', '24a7e57b-d310-44f7-aacf-d433e24698f0', '1c930af4-00df-471e-b38a-b65fe54aa2ee', 'c2ae9f3a-b33f-4e88-b6cb-b9fe379b5018'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:45 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Delete snapshot completed successfully. Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0e6251dc-d1ed-4800-a3fb-9ea5d2d2411f tempest-SnapshotsActionsTest-2050232744 None] Lock "cinder-5f645aca-e91a-48af-9a32-3a1ddee1fad9-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Flow 'volume_create_manager' (1c0c4b15-0070-4e9a-9f02-539eaca25b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5a1ce1-5e08-4447-857a-d97e9cc05fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5a1ce1-5e08-4447-857a-d97e9cc05fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1217771982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdf8224-c1af-4844-8288-799af785fb00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0e4103d5e343e6b666bf9bdc1ad00f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:46Z,use_quota=True,user_id='3824c0f709c14566897c51db594218e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fab27f6-c019-46c8-8ebd-cb2d71d23716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fab27f6-c019-46c8-8ebd-cb2d71d23716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef9cf222-9929-4975-b30d-5b6182127a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef9cf222-9929-4975-b30d-5b6182127a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fdf8224-c1af-4844-8288-799af785fb00', 'volume_name': 'volume-1fdf8224-c1af-4844-8288-799af785fb00', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745b0af4-8dea-4aeb-9820-46c2043f5e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745b0af4-8dea-4aeb-9820-46c2043f5e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d8f0fd-ccd8-4d40-8468-2194eb45db17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:45 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Volume 1fdf8224-c1af-4844-8288-799af785fb00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fdf8224-c1af-4844-8288-799af785fb00', 'volume_size': 1} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1217771982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdf8224-c1af-4844-8288-799af785fb00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0e4103d5e343e6b666bf9bdc1ad00f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:46Z,use_quota=True,user_id='3824c0f709c14566897c51db594218e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Creating volume 1fdf8224-c1af-4844-8288-799af785fb00 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:26:45 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:26:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1fdf8224-c1af-4844-8288-799af785fb00 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:45 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1fdf8224-c1af-4844-8288-799af785fb00 1073741824 Jul 23 22:26:46 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:46 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.337s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:26:46 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Deleted volume successfully. Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad1adef5-be5a-4d1d-998d-cbaac64f86d6 tempest-VolumeQuotasNegativeTestJSON-2117974884 None] Lock "cinder-eaf27c35-7e40-4a81-adae-da3092b69d7b-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Acquiring lock "cinder-6b0026c2-255c-4842-a84e-484018038acb-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Lock "cinder-6b0026c2-255c-4842-a84e-484018038acb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Acquiring lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Acquiring lock "cinder-quobyte-6b0026c2-255c-4842-a84e-484018038acb" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Lock "cinder-quobyte-6b0026c2-255c-4842-a84e-484018038acb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Deleting offline snapshot 6b0026c2-255c-4842-a84e-484018038acb of volume 8ef43c0e-9842-4b33-8642-a77823a8085d {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] snapshot_file for this snap is: volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2224fdc9-bc7e-4197-a58f-5e3279f5b1fc]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:46 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1fdf8224-c1af-4844-8288-799af785fb00 1073741824" returned: 0 in 0.606s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1fdf8224-c1af-4844-8288-799af785fb00 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:46 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1fdf8224-c1af-4844-8288-799af785fb00 Jul 23 22:26:46 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:46 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb Jul 23 22:26:46 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:46 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1fdf8224-c1af-4844-8288-799af785fb00" returned: 0 in 0.290s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d8f0fd-ccd8-4d40-8468-2194eb45db17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fdf8224-c1af-4844-8288-799af785fb00', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4909922-3134-4316-8262-65832a57b9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:46 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:46 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Volume volume-1fdf8224-c1af-4844-8288-799af785fb00 (1fdf8224-c1af-4844-8288-799af785fb00): created successfully Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4909922-3134-4316-8262-65832a57b9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Flow 'volume_create_manager' (1c0c4b15-0070-4e9a-9f02-539eaca25b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb" returned: 0 in 0.424s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef43c0e-9842-4b33-8642-a77823a8085d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:26:46 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-5c9b13d2-1a3d-4d7c-9082-d62c8797aa54 tempest-VolumesTransfersV355Test-436787191 None] Created volume successfully. Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbf99c6-3cdd-4639-9f3e-7e83d55d0a3f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:47 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d Jul 23 22:26:47 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:47 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d" returned: 0 in 0.384s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:47 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb Jul 23 22:26:47 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:47 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb" returned: 0 in 0.401s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:47 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb Jul 23 22:26:47 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:48 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d.6b0026c2-255c-4842-a84e-484018038acb" returned: 0 in 0.360s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Lock "cinder-quobyte-6b0026c2-255c-4842-a84e-484018038acb" released by "_delete_snapshot" :: held 1.712s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" released by "delete_snapshot" :: held 1.741s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:48 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Created reservations ['29b30971-08bd-4af8-b2ac-8791475f229a', '729d240c-7273-4c54-b75d-9f2edf440128', '5eb0a5b6-b68e-43b2-8e0d-a14b4723d319', 'fb6c662d-d62e-45e9-a40e-6af67264b930'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:48 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Delete snapshot completed successfully. Jul 23 22:26:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e3ab511b-4ba8-4fb8-b204-21f653512634 tempest-SnapshotsActionsTest-246532653 None] Lock "cinder-6b0026c2-255c-4842-a84e-484018038acb-delete_snapshot" released by "delete_snapshot" :: held 1.977s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Acquiring lock "cinder-8ef43c0e-9842-4b33-8642-a77823a8085d-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Lock "cinder-8ef43c0e-9842-4b33-8642-a77823a8085d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Acquiring lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" acquired by "delete_volume" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:49 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed52379-c73d-443a-b040-a08afaa6ad70]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:49 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-0100381b-0102-4019-9b2c-f53fa7804de7 tempest-VolumesTransfersV355Test-131631058 None] Transfer volume completed successfully. Jul 23 22:26:49 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d Jul 23 22:26:49 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:49 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d" returned: 0 in 0.593s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:49 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d Jul 23 22:26:49 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Acquiring lock "cinder-1fdf8224-c1af-4844-8288-799af785fb00-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Lock "cinder-1fdf8224-c1af-4844-8288-799af785fb00-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:49 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8ef43c0e-9842-4b33-8642-a77823a8085d" returned: 0 in 0.360s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Lock "cinder-quobyte-8ef43c0e-9842-4b33-8642-a77823a8085d" released by "delete_volume" :: held 1.071s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Acquiring lock "cinder-quobyte-1fdf8224-c1af-4844-8288-799af785fb00" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Lock "cinder-quobyte-1fdf8224-c1af-4844-8288-799af785fb00" acquired by "delete_volume" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fc16f0-bf9f-41d1-b70c-ce1fd21118bf]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1fdf8224-c1af-4844-8288-799af785fb00 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Created reservations ['056844ed-3a61-470a-9fe6-e563c2bd3ce1', '6c493230-313d-4a0b-87f2-a8bbdadfe4a2', 'd6366434-267e-44ae-97eb-ccec9e3728f5', '5791a97b-e6db-4642-ab97-6b862b07aa82'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:50 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1fdf8224-c1af-4844-8288-799af785fb00 Jul 23 22:26:50 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:50 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:26:50 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:50 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:50 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.272s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:26:50 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Deleted volume successfully. Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1fdf8224-c1af-4844-8288-799af785fb00" returned: 0 in 0.397s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1fdf8224-c1af-4844-8288-799af785fb00 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-23143f42-0070-442d-862a-cce3f2860ec4 tempest-SnapshotsActionsTest-246532653 None] Lock "cinder-8ef43c0e-9842-4b33-8642-a77823a8085d-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:50 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1fdf8224-c1af-4844-8288-799af785fb00 Jul 23 22:26:50 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:50 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1fdf8224-c1af-4844-8288-799af785fb00" returned: 0 in 0.260s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Lock "cinder-quobyte-1fdf8224-c1af-4844-8288-799af785fb00" released by "delete_volume" :: held 0.703s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Created reservations ['48862ae0-ae74-415f-bd09-3a279e2eb501', '1a7732f8-cc75-42c9-bcd9-38956748cd16', '673b1d97-2c98-4b9d-ad22-bf8e92a8cd02', 'c24359dc-9d4a-4d28-9f20-7e7ca64a205a'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=167,cinder:INSERT=43,cinder:UPDATE=178,cinder:DELETE=9 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:INSERT=59,cinder:UPDATE=173,cinder:SELECT=163,cinder:DELETE=10 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:50 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:26:50 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:51 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.275s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:51 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:26:51 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Deleted volume successfully. Jul 23 22:26:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-88baa83a-b935-499e-b423-094ca9d79a29 tempest-VolumesTransfersV355Test-1065492236 None] Lock "cinder-1fdf8224-c1af-4844-8288-799af785fb00-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:51 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:26:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Flow 'volume_create_manager' (74c7e919-5f52-4663-8198-0af9ae46a009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f538384f-6bbd-4747-bcbe-a7952a674d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f538384f-6bbd-4747-bcbe-a7952a674d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-810275863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95a4a69-23f2-4252-b798-9424f98ed668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0e4103d5e343e6b666bf9bdc1ad00f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:52Z,use_quota=True,user_id='3824c0f709c14566897c51db594218e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebaa83f1-71c6-453b-be8f-6cd154995318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebaa83f1-71c6-453b-be8f-6cd154995318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caceef5d-bbd8-4ba4-abf5-fbaf33fc0f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caceef5d-bbd8-4ba4-abf5-fbaf33fc0f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c95a4a69-23f2-4252-b798-9424f98ed668', 'volume_name': 'volume-c95a4a69-23f2-4252-b798-9424f98ed668', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f6cd6c-b1be-4d77-b893-d63af3930d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f6cd6c-b1be-4d77-b893-d63af3930d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47f1b52-ed38-475a-96cd-562a3fc8874d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:51 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Volume c95a4a69-23f2-4252-b798-9424f98ed668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c95a4a69-23f2-4252-b798-9424f98ed668', 'volume_size': 1} Jul 23 22:26:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-810275863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95a4a69-23f2-4252-b798-9424f98ed668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac0e4103d5e343e6b666bf9bdc1ad00f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:52Z,use_quota=True,user_id='3824c0f709c14566897c51db594218e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:26:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Creating volume c95a4a69-23f2-4252-b798-9424f98ed668 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:26:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:26:52 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:26:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c95a4a69-23f2-4252-b798-9424f98ed668 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:52 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c95a4a69-23f2-4252-b798-9424f98ed668 1073741824 Jul 23 22:26:52 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:52 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c95a4a69-23f2-4252-b798-9424f98ed668 1073741824" returned: 0 in 0.705s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c95a4a69-23f2-4252-b798-9424f98ed668 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:52 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c95a4a69-23f2-4252-b798-9424f98ed668 Jul 23 22:26:52 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:53 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c95a4a69-23f2-4252-b798-9424f98ed668" returned: 0 in 0.377s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47f1b52-ed38-475a-96cd-562a3fc8874d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c95a4a69-23f2-4252-b798-9424f98ed668', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc4f633-45a7-4e28-bfae-92c09bedf570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:53 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Volume volume-c95a4a69-23f2-4252-b798-9424f98ed668 (c95a4a69-23f2-4252-b798-9424f98ed668): created successfully Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc4f633-45a7-4e28-bfae-92c09bedf570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Flow 'volume_create_manager' (74c7e919-5f52-4663-8198-0af9ae46a009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:53 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f07d7c3b-203b-4473-bd12-3464e943e451 tempest-VolumesTransfersV355Test-436787191 None] Created volume successfully. Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Flow 'volume_create_manager' (65ec5e52-e8af-44ef-b3bd-d40ef9a17cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7948cdf3-6c2a-4930-94f1-c9f805c34612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7948cdf3-6c2a-4930-94f1-c9f805c34612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1390026142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23693e5-ad21-463e-97d6-22254f1a7a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc32deb07ee4cc6ad3832d917876b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:53Z,use_quota=True,user_id='569044e668134a5898ce884e351292de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea17faac-2619-4d3c-be43-85fb39929a65),volume_type_id=ea17faac-2619-4d3c-be43-85fb39929a65)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4b02cb-8abd-4484-8924-6f4741cf56fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4b02cb-8abd-4484-8924-6f4741cf56fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dee4b51-6819-463b-9f19-fdd3d333b300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dee4b51-6819-463b-9f19-fdd3d333b300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f23693e5-ad21-463e-97d6-22254f1a7a48', 'volume_name': 'volume-f23693e5-ad21-463e-97d6-22254f1a7a48', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e166d4ea-c18e-4539-aec3-8f9862140690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e166d4ea-c18e-4539-aec3-8f9862140690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e886fa7-dbe3-4edf-a55c-afa4de145d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:53 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Volume f23693e5-ad21-463e-97d6-22254f1a7a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f23693e5-ad21-463e-97d6-22254f1a7a48', 'volume_size': 1} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1390026142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23693e5-ad21-463e-97d6-22254f1a7a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc32deb07ee4cc6ad3832d917876b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:26:53Z,use_quota=True,user_id='569044e668134a5898ce884e351292de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea17faac-2619-4d3c-be43-85fb39929a65),volume_type_id=ea17faac-2619-4d3c-be43-85fb39929a65)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Creating volume f23693e5-ad21-463e-97d6-22254f1a7a48 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:26:53 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:26:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f23693e5-ad21-463e-97d6-22254f1a7a48 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:53 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f23693e5-ad21-463e-97d6-22254f1a7a48 1073741824 Jul 23 22:26:53 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:54 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f23693e5-ad21-463e-97d6-22254f1a7a48 1073741824" returned: 0 in 0.697s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f23693e5-ad21-463e-97d6-22254f1a7a48 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:54 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f23693e5-ad21-463e-97d6-22254f1a7a48 Jul 23 22:26:54 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Acquiring lock "cinder-c95a4a69-23f2-4252-b798-9424f98ed668-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Lock "cinder-c95a4a69-23f2-4252-b798-9424f98ed668-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Acquiring lock "cinder-quobyte-c95a4a69-23f2-4252-b798-9424f98ed668" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Lock "cinder-quobyte-c95a4a69-23f2-4252-b798-9424f98ed668" acquired by "delete_volume" :: waited 0.028s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:54 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd27e06e-ed86-46e3-ba0b-31595c8fa78c]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c95a4a69-23f2-4252-b798-9424f98ed668 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:54 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c95a4a69-23f2-4252-b798-9424f98ed668 Jul 23 22:26:54 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:54 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f23693e5-ad21-463e-97d6-22254f1a7a48" returned: 0 in 0.457s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:26:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e886fa7-dbe3-4edf-a55c-afa4de145d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f23693e5-ad21-463e-97d6-22254f1a7a48', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899a16ec-967d-4d3e-94ac-f1811a294e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:26:54 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Volume volume-f23693e5-ad21-463e-97d6-22254f1a7a48 (f23693e5-ad21-463e-97d6-22254f1a7a48): created successfully Jul 23 22:26:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899a16ec-967d-4d3e-94ac-f1811a294e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:26:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Flow 'volume_create_manager' (65ec5e52-e8af-44ef-b3bd-d40ef9a17cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:26:54 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4c5e5d38-0ee1-476b-955d-208af1872dd5 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Created volume successfully. Jul 23 22:26:55 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c95a4a69-23f2-4252-b798-9424f98ed668" returned: 0 in 0.460s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c95a4a69-23f2-4252-b798-9424f98ed668 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:55 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c95a4a69-23f2-4252-b798-9424f98ed668 Jul 23 22:26:55 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:55 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c95a4a69-23f2-4252-b798-9424f98ed668" returned: 0 in 0.439s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Lock "cinder-quobyte-c95a4a69-23f2-4252-b798-9424f98ed668" released by "delete_volume" :: held 0.980s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:55 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Created reservations ['87c2a986-f55e-4fd2-9352-155d3e749efb', '434fb6c2-ae79-4702-b899-b3286761ae51', '68e76ce3-7e6c-4228-83ec-424d9eb4354b', 'd723ca0e-e3f8-4e50-910b-77d038dc2c54'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:55 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:26:55 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:56 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.318s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:56 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:26:56 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Deleted volume successfully. Jul 23 22:26:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-76c6fe5f-3b7d-476d-8f1f-3d53e67e8a7f tempest-VolumesTransfersV355Test-1065492236 None] Lock "cinder-c95a4a69-23f2-4252-b798-9424f98ed668-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c08f002e-058a-461a-b31f-29d491591710 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c08f002e-058a-461a-b31f-29d491591710 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c08f002e-058a-461a-b31f-29d491591710 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c08f002e-058a-461a-b31f-29d491591710 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c08f002e-058a-461a-b31f-29d491591710 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c08f002e-058a-461a-b31f-29d491591710 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:56 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:26:56 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:56 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c08f002e-058a-461a-b31f-29d491591710 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.254s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:56 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-c08f002e-058a-461a-b31f-29d491591710 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:26:56 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c08f002e-058a-461a-b31f-29d491591710 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Retype volume completed successfully. Jul 23 22:26:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Acquiring lock "cinder-f23693e5-ad21-463e-97d6-22254f1a7a48-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Lock "cinder-f23693e5-ad21-463e-97d6-22254f1a7a48-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Acquiring lock "cinder-quobyte-f23693e5-ad21-463e-97d6-22254f1a7a48" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:26:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Lock "cinder-quobyte-f23693e5-ad21-463e-97d6-22254f1a7a48" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:26:57 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0a32b8-2b1b-463c-aa0d-5da490f886ff]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:26:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f23693e5-ad21-463e-97d6-22254f1a7a48 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:57 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f23693e5-ad21-463e-97d6-22254f1a7a48 Jul 23 22:26:57 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:58 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f23693e5-ad21-463e-97d6-22254f1a7a48" returned: 0 in 0.490s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f23693e5-ad21-463e-97d6-22254f1a7a48 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:58 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f23693e5-ad21-463e-97d6-22254f1a7a48 Jul 23 22:26:58 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:58 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f23693e5-ad21-463e-97d6-22254f1a7a48" returned: 0 in 0.342s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Lock "cinder-quobyte-f23693e5-ad21-463e-97d6-22254f1a7a48" released by "delete_volume" :: held 0.889s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:26:58 devstack cinder-volume[88308]: WARNING cinder.quota [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:26:58 devstack cinder-volume[88308]: WARNING cinder.quota [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:26:58 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Created reservations ['b167519d-f005-4f61-9911-463d8f9342e3', '9e243b7b-daab-4099-a97f-2493756c8a0b', '561dfa19-c00b-4535-871c-f56b98902716', '7975679d-dfc0-48a1-8cd7-cdbddaba9c2a'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:26:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:26:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:26:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:26:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:26:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:26:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:26:58 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:26:58 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:26:58 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-bcde9648-09f3-436b-a13f-7b242b13821e req-7f5e41c2-f7c0-4e0b-b584-8904630d0fdb tempest-AttachVolumeNegativeTest-577220995 None] Terminate volume connection completed successfully. Jul 23 22:26:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-bcde9648-09f3-436b-a13f-7b242b13821e req-7f5e41c2-f7c0-4e0b-b584-8904630d0fdb tempest-AttachVolumeNegativeTest-577220995 None] Deleting attachment 217f1f85-84f5-484b-9578-d0ac8e6ff5c2. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:26:58 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jul 23 22:26:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.373s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:26:58 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:26:58 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Deleted volume successfully. Jul 23 22:26:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3cf7668d-fcff-4635-a2e4-f46e62ae0184 tempest-VolumeRetypeWithoutMigrationTest-1106468627 None] Lock "cinder-f23693e5-ad21-463e-97d6-22254f1a7a48-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Flow 'volume_create_manager' (762e70cf-5bb6-4d16-90e9-f197ca60c851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20eb22ea-7c4a-4f7b-8c31-86f8e213adb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20eb22ea-7c4a-4f7b-8c31-86f8e213adb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-761915690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75f7d76-d122-471b-9cb9-25add0a4658b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0880a3510e3248a2ad2462e50f9bb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:08Z,use_quota=True,user_id='cf4712c694b141be8ebaebab76e1c06d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b04402e-6e2a-450a-b066-0c4d85330fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b04402e-6e2a-450a-b066-0c4d85330fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95f1bd8-8024-49b5-99ff-4f739a2b47dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95f1bd8-8024-49b5-99ff-4f739a2b47dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a75f7d76-d122-471b-9cb9-25add0a4658b', 'volume_name': 'volume-a75f7d76-d122-471b-9cb9-25add0a4658b', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7acb8d28-975c-44b2-b1f5-cd66bbda4b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7acb8d28-975c-44b2-b1f5-cd66bbda4b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de1ec13-c8bc-43ec-8d0b-313205944d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:08 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Volume a75f7d76-d122-471b-9cb9-25add0a4658b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a75f7d76-d122-471b-9cb9-25add0a4658b', 'volume_size': 1} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-761915690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a75f7d76-d122-471b-9cb9-25add0a4658b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0880a3510e3248a2ad2462e50f9bb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:08Z,use_quota=True,user_id='cf4712c694b141be8ebaebab76e1c06d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Creating volume a75f7d76-d122-471b-9cb9-25add0a4658b {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:27:08 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a75f7d76-d122-471b-9cb9-25add0a4658b 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:08 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a75f7d76-d122-471b-9cb9-25add0a4658b 1073741824 Jul 23 22:27:08 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Flow 'volume_create_manager' (6612b94b-a925-4eb5-9397-4b615b446dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25173564-df9e-419f-86ed-ee4e98a73a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:08 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25173564-df9e-419f-86ed-ee4e98a73a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1260084727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961310e0-ef7c-4b81-9431-c341b67d2da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9407e83e548b40d19b908ccba57a8e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:09Z,use_quota=True,user_id='ecda5c4e07a74dc9b3e8c957c2c6f6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0c910e-693b-47c0-8a0d-b322e4539f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c0c910e-693b-47c0-8a0d-b322e4539f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9610d84f-b533-44a9-96e9-bcdf96857af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9610d84f-b533-44a9-96e9-bcdf96857af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '961310e0-ef7c-4b81-9431-c341b67d2da9', 'volume_name': 'volume-961310e0-ef7c-4b81-9431-c341b67d2da9', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25aacc0-8484-44dc-a4cb-2e9af1c7a6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25aacc0-8484-44dc-a4cb-2e9af1c7a6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194e1aa4-896a-4b28-bbc8-2708457bb41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:08 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Volume 961310e0-ef7c-4b81-9431-c341b67d2da9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-961310e0-ef7c-4b81-9431-c341b67d2da9', 'volume_size': 1} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a75f7d76-d122-471b-9cb9-25add0a4658b 1073741824" returned: 0 in 0.612s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a75f7d76-d122-471b-9cb9-25add0a4658b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:08 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a75f7d76-d122-471b-9cb9-25add0a4658b Jul 23 22:27:08 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:09 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a75f7d76-d122-471b-9cb9-25add0a4658b" returned: 0 in 0.306s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.350s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1260084727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961310e0-ef7c-4b81-9431-c341b67d2da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9407e83e548b40d19b908ccba57a8e46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:09Z,use_quota=True,user_id='ecda5c4e07a74dc9b3e8c957c2c6f6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Creating volume 961310e0-ef7c-4b81-9431-c341b67d2da9 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:27:09 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:09 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9 1073741824 Jul 23 22:27:09 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de1ec13-c8bc-43ec-8d0b-313205944d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a75f7d76-d122-471b-9cb9-25add0a4658b', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (502e7bdb-6d33-4a8c-a350-1126b2235852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:09 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Volume volume-a75f7d76-d122-471b-9cb9-25add0a4658b (a75f7d76-d122-471b-9cb9-25add0a4658b): created successfully Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (502e7bdb-6d33-4a8c-a350-1126b2235852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Flow 'volume_create_manager' (762e70cf-5bb6-4d16-90e9-f197ca60c851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:09 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-dc7822ba-dc62-4c49-94a7-5d631fc7d2c8 tempest-VolumesTransfersV357Test-1083519892 None] Created volume successfully. Jul 23 22:27:09 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9 1073741824" returned: 0 in 0.626s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:09 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9 Jul 23 22:27:09 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:10 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9" returned: 0 in 0.404s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:27:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194e1aa4-896a-4b28-bbc8-2708457bb41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-961310e0-ef7c-4b81-9431-c341b67d2da9', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5db2658-144c-4907-9b3d-7028809a44c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:10 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Volume volume-961310e0-ef7c-4b81-9431-c341b67d2da9 (961310e0-ef7c-4b81-9431-c341b67d2da9): created successfully Jul 23 22:27:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5db2658-144c-4907-9b3d-7028809a44c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Flow 'volume_create_manager' (6612b94b-a925-4eb5-9397-4b615b446dfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:10 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-d1c7a92c-25fc-478b-b512-1a0a1cb60ccb tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Created volume successfully. Jul 23 22:27:11 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-68b666dd-747d-447e-b677-4872f7f5cba2 tempest-VolumesTransfersV357Test-1632237805 None] Transfer volume completed successfully. Jul 23 22:27:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Creating offline snapshot fd978554-ea66-4671-b5dc-a661c5143386 of volume 961310e0-ef7c-4b81-9431-c341b67d2da9 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:27:11 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd2ee18-bf4f-411c-b6c1-c79317afc98e]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:11 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9 Jul 23 22:27:11 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:11 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9" returned: 0 in 0.608s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:12 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386 1G Jul 23 22:27:12 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Acquiring lock "cinder-a75f7d76-d122-471b-9cb9-25add0a4658b-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Lock "cinder-a75f7d76-d122-471b-9cb9-25add0a4658b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Acquiring lock "cinder-quobyte-a75f7d76-d122-471b-9cb9-25add0a4658b" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Lock "cinder-quobyte-a75f7d76-d122-471b-9cb9-25add0a4658b" acquired by "delete_volume" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:12 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d879a623-1cf1-4a6f-a42d-3fca3ecbcfcc]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a75f7d76-d122-471b-9cb9-25add0a4658b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:12 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386 1G" returned: 0 in 0.769s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:12 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a75f7d76-d122-471b-9cb9-25add0a4658b Jul 23 22:27:12 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961310e0-ef7c-4b81-9431-c341b67d2da9 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:12 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961310e0-ef7c-4b81-9431-c341b67d2da9 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386 Jul 23 22:27:12 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:13 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a75f7d76-d122-471b-9cb9-25add0a4658b" returned: 0 in 0.543s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a75f7d76-d122-471b-9cb9-25add0a4658b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:13 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-961310e0-ef7c-4b81-9431-c341b67d2da9 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386" returned: 0 in 0.378s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:13 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386 is being set with open permissions: ugo+rw Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:13 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a75f7d76-d122-471b-9cb9-25add0a4658b Jul 23 22:27:13 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:13 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386 Jul 23 22:27:13 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:13 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a75f7d76-d122-471b-9cb9-25add0a4658b" returned: 0 in 0.400s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:13 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386" returned: 0 in 0.378s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Lock "cinder-quobyte-a75f7d76-d122-471b-9cb9-25add0a4658b" released by "delete_volume" :: held 1.004s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:13 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.info Jul 23 22:27:13 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Created reservations ['d255f26e-35f8-4b20-aab8-b44b93b63413', '88d9b54d-a363-45d6-87cb-fdddbddd878c', '450bd852-6612-4fda-945c-fc04bf7409a0', 'bbbf6867-7a06-4d67-90f1-4d5ef5a52469'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:13 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:27:13 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:13 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.info" returned: 0 in 0.433s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:13 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.info is being set with open permissions: ugo+rw Jul 23 22:27:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:14 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.info Jul 23 22:27:14 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:14 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.348s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:14 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:27:14 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Deleted volume successfully. Jul 23 22:27:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-119cc9b9-69b6-4f60-8a22-4f4b0749013a tempest-VolumesTransfersV357Test-3420825 None] Lock "cinder-a75f7d76-d122-471b-9cb9-25add0a4658b-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:14 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.info" returned: 0 in 0.392s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.123s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:14 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e772d037-c4ee-4ac6-8c44-77b4bd32a974 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Create snapshot completed successfully Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Flow 'volume_create_manager' (0bdb2ab7-1b43-40d4-a78f-c717717899ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d04059-c810-4533-aa12-6bf15d9410b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d04059-c810-4533-aa12-6bf15d9410b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-658062409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945a11d7-0c02-4f77-855e-22c3351b0307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0880a3510e3248a2ad2462e50f9bb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:16Z,use_quota=True,user_id='cf4712c694b141be8ebaebab76e1c06d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410b59cc-8a2a-430d-9db0-15f293573f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410b59cc-8a2a-430d-9db0-15f293573f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8cda9a2-ce1f-48ee-9469-fd339f9c6735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8cda9a2-ce1f-48ee-9469-fd339f9c6735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '945a11d7-0c02-4f77-855e-22c3351b0307', 'volume_name': 'volume-945a11d7-0c02-4f77-855e-22c3351b0307', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8883be9-7bf6-40b7-a878-1d63b63b9faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8883be9-7bf6-40b7-a878-1d63b63b9faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b420f9c4-7ca5-484d-931e-3b0b86c40486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:15 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Volume 945a11d7-0c02-4f77-855e-22c3351b0307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-945a11d7-0c02-4f77-855e-22c3351b0307', 'volume_size': 1} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-658062409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945a11d7-0c02-4f77-855e-22c3351b0307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0880a3510e3248a2ad2462e50f9bb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:16Z,use_quota=True,user_id='cf4712c694b141be8ebaebab76e1c06d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Creating volume 945a11d7-0c02-4f77-855e-22c3351b0307 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:27:15 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:27:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-945a11d7-0c02-4f77-855e-22c3351b0307 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:15 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-945a11d7-0c02-4f77-855e-22c3351b0307 1073741824 Jul 23 22:27:15 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Acquiring lock "cinder-fd978554-ea66-4671-b5dc-a661c5143386-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "cinder-fd978554-ea66-4671-b5dc-a661c5143386-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Acquiring lock "cinder-quobyte-961310e0-ef7c-4b81-9431-c341b67d2da9" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "cinder-quobyte-961310e0-ef7c-4b81-9431-c341b67d2da9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Acquiring lock "cinder-quobyte-fd978554-ea66-4671-b5dc-a661c5143386" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "cinder-quobyte-fd978554-ea66-4671-b5dc-a661c5143386" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Deleting offline snapshot fd978554-ea66-4671-b5dc-a661c5143386 of volume 961310e0-ef7c-4b81-9431-c341b67d2da9 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:27:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] snapshot_file for this snap is: volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:27:16 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6790fb-f0fe-41c0-a9a0-9bd06b49df94]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:16 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-945a11d7-0c02-4f77-855e-22c3351b0307 1073741824" returned: 0 in 0.886s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-945a11d7-0c02-4f77-855e-22c3351b0307 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:16 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-945a11d7-0c02-4f77-855e-22c3351b0307 Jul 23 22:27:16 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:16 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386 Jul 23 22:27:16 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:17 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-945a11d7-0c02-4f77-855e-22c3351b0307" returned: 0 in 0.399s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:27:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b420f9c4-7ca5-484d-931e-3b0b86c40486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945a11d7-0c02-4f77-855e-22c3351b0307', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed74677a-20d5-473c-b4d9-dd1bc8bc6c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:17 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:17 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Volume volume-945a11d7-0c02-4f77-855e-22c3351b0307 (945a11d7-0c02-4f77-855e-22c3351b0307): created successfully Jul 23 22:27:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed74677a-20d5-473c-b4d9-dd1bc8bc6c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Flow 'volume_create_manager' (0bdb2ab7-1b43-40d4-a78f-c717717899ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386" returned: 0 in 0.556s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-961310e0-ef7c-4b81-9431-c341b67d2da9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:27:17 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-09ba2698-4990-4620-ae3d-b6f0f9d3f8da tempest-VolumesTransfersV357Test-1083519892 None] Created volume successfully. Jul 23 22:27:17 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d45314-c0ab-4f97-9797-6c5f5fc747cd]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:17 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9 Jul 23 22:27:17 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:17 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9" returned: 0 in 0.515s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:17 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386 Jul 23 22:27:17 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Acquiring lock "cinder-945a11d7-0c02-4f77-855e-22c3351b0307-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Lock "cinder-945a11d7-0c02-4f77-855e-22c3351b0307-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Acquiring lock "cinder-quobyte-945a11d7-0c02-4f77-855e-22c3351b0307" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:18 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386" returned: 0 in 0.650s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Lock "cinder-quobyte-945a11d7-0c02-4f77-855e-22c3351b0307" acquired by "delete_volume" :: waited 0.056s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:18 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386 Jul 23 22:27:18 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:18 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d5c022-c3ef-4f99-bbe0-473f5fc43229]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-945a11d7-0c02-4f77-855e-22c3351b0307 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:18 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-945a11d7-0c02-4f77-855e-22c3351b0307 Jul 23 22:27:18 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:18 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9.fd978554-ea66-4671-b5dc-a661c5143386" returned: 0 in 0.566s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "cinder-quobyte-fd978554-ea66-4671-b5dc-a661c5143386" released by "_delete_snapshot" :: held 2.447s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "cinder-quobyte-961310e0-ef7c-4b81-9431-c341b67d2da9" released by "delete_snapshot" :: held 2.485s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:19 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-945a11d7-0c02-4f77-855e-22c3351b0307" returned: 0 in 0.574s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-945a11d7-0c02-4f77-855e-22c3351b0307 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:19 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-945a11d7-0c02-4f77-855e-22c3351b0307 Jul 23 22:27:19 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:19 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Created reservations ['1610a035-4502-4de5-ad1e-ea20e67d719b', 'a1390327-a2d0-4aef-b83b-f003ee2a7712', '742deb4d-7197-4e33-9d4a-239eca5a300f', '5e95a5a0-0595-425c-85dc-27580feac75a'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:27:19 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Delete snapshot completed successfully. Jul 23 22:27:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6db61035-3d0b-43ac-9e9d-d4b2f8d68085 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "cinder-fd978554-ea66-4671-b5dc-a661c5143386-delete_snapshot" released by "delete_snapshot" :: held 2.756s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:19 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-945a11d7-0c02-4f77-855e-22c3351b0307" returned: 0 in 0.440s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Lock "cinder-quobyte-945a11d7-0c02-4f77-855e-22c3351b0307" released by "delete_volume" :: held 1.127s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:19 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Created reservations ['1581388e-56c3-4831-a145-1e018000a8d6', 'e0b3c7a6-5a35-4d54-9618-8131998a6e43', '5fdd00a2-20d6-46bb-9dbb-145f290694b2', '0cf0b1d7-bd5d-4644-afde-e88e365e1c91'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:27:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:19 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:27:19 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Acquiring lock "cinder-961310e0-ef7c-4b81-9431-c341b67d2da9-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:20 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "cinder-961310e0-ef7c-4b81-9431-c341b67d2da9-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:20 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Acquiring lock "cinder-quobyte-961310e0-ef7c-4b81-9431-c341b67d2da9" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:20 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "cinder-quobyte-961310e0-ef7c-4b81-9431-c341b67d2da9" acquired by "delete_volume" :: waited 0.040s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:20 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.521s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:20 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:27:20 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[960c0fc2-60d6-4a63-9d94-cdc538876854]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:20 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Deleted volume successfully. Jul 23 22:27:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:20 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-323656fc-e2f3-4a63-951e-44884807888f tempest-VolumesTransfersV357Test-3420825 None] Lock "cinder-945a11d7-0c02-4f77-855e-22c3351b0307-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:20 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9 Jul 23 22:27:20 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:20 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9" returned: 0 in 0.606s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:20 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9 Jul 23 22:27:20 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:21 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-961310e0-ef7c-4b81-9431-c341b67d2da9" returned: 0 in 0.416s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "cinder-quobyte-961310e0-ef7c-4b81-9431-c341b67d2da9" released by "delete_volume" :: held 1.154s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:21 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Created reservations ['7540a779-8422-48ee-b0d6-be88798793f6', 'e901dfda-cc30-440b-b32a-be8255db5dfd', '31ca9917-b8d2-4f99-96a1-7c80e52b4772', '5dd4a915-ae7b-4f0b-9fe6-be8fbaa4ab21'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:27:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:21 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:27:21 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:21 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.371s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:21 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:27:21 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Deleted volume successfully. Jul 23 22:27:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-cdac2ae3-82d5-4ef1-8ff7-b57c68745623 tempest-VolumeSnapshotQuotasNegativeTestJSON-810786048 None] Lock "cinder-961310e0-ef7c-4b81-9431-c341b67d2da9-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Flow 'volume_create_manager' (dcec3be9-5489-4e9a-afe8-4a5fd4c47020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5336a2-26e7-497f-98be-201af60d7a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5336a2-26e7-497f-98be-201af60d7a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-295322383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc9bd75-8c13-4870-9a74-2929cccd5d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c3122d38d448acb6881f5b071fa9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:25Z,use_quota=True,user_id='03d9ef07185f406e96e90b52aa6df9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683f724e-f839-4544-9f7a-2da217c4e0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683f724e-f839-4544-9f7a-2da217c4e0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94aca231-0632-453a-bd20-2e0cf00b84cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94aca231-0632-453a-bd20-2e0cf00b84cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc9bd75-8c13-4870-9a74-2929cccd5d17', 'volume_name': 'volume-afc9bd75-8c13-4870-9a74-2929cccd5d17', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85d4e47-e41f-4d63-a5a5-86b3eb8366f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85d4e47-e41f-4d63-a5a5-86b3eb8366f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9277ff42-89e1-428b-a2a4-58304475f314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:25 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Volume afc9bd75-8c13-4870-9a74-2929cccd5d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc9bd75-8c13-4870-9a74-2929cccd5d17', 'volume_size': 1} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-295322383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc9bd75-8c13-4870-9a74-2929cccd5d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c3122d38d448acb6881f5b071fa9e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:25Z,use_quota=True,user_id='03d9ef07185f406e96e90b52aa6df9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Creating volume afc9bd75-8c13-4870-9a74-2929cccd5d17 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:27:25 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:27:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-afc9bd75-8c13-4870-9a74-2929cccd5d17 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:25 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-afc9bd75-8c13-4870-9a74-2929cccd5d17 1073741824 Jul 23 22:27:25 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:26 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:26 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:27:26 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-afc9bd75-8c13-4870-9a74-2929cccd5d17 1073741824" returned: 0 in 0.874s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-afc9bd75-8c13-4870-9a74-2929cccd5d17 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:26 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-afc9bd75-8c13-4870-9a74-2929cccd5d17 Jul 23 22:27:26 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:26 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-afc9bd75-8c13-4870-9a74-2929cccd5d17" returned: 0 in 0.383s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9277ff42-89e1-428b-a2a4-58304475f314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc9bd75-8c13-4870-9a74-2929cccd5d17', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:26 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44965ca9-1d89-4d72-9341-6ac656a002ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.604s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 28 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:27:26 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Volume volume-afc9bd75-8c13-4870-9a74-2929cccd5d17 (afc9bd75-8c13-4870-9a74-2929cccd5d17): created successfully Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44965ca9-1d89-4d72-9341-6ac656a002ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Flow 'volume_create_manager' (dcec3be9-5489-4e9a-afe8-4a5fd4c47020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:26 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-fd30daa6-c096-4f79-953f-0cd19ac02d53 tempest-VolumesMetadataTest-1894329730 None] Created volume successfully. Jul 23 22:27:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Acquiring lock "cinder-afc9bd75-8c13-4870-9a74-2929cccd5d17-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Lock "cinder-afc9bd75-8c13-4870-9a74-2929cccd5d17-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Acquiring lock "cinder-quobyte-afc9bd75-8c13-4870-9a74-2929cccd5d17" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Lock "cinder-quobyte-afc9bd75-8c13-4870-9a74-2929cccd5d17" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:28 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[13182aab-1d16-468f-8500-f296fc82aa2a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-afc9bd75-8c13-4870-9a74-2929cccd5d17 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:28 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-afc9bd75-8c13-4870-9a74-2929cccd5d17 Jul 23 22:27:28 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:28 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-afc9bd75-8c13-4870-9a74-2929cccd5d17" returned: 0 in 0.516s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-afc9bd75-8c13-4870-9a74-2929cccd5d17 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:28 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-afc9bd75-8c13-4870-9a74-2929cccd5d17 Jul 23 22:27:28 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:29 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-afc9bd75-8c13-4870-9a74-2929cccd5d17" returned: 0 in 0.317s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Lock "cinder-quobyte-afc9bd75-8c13-4870-9a74-2929cccd5d17" released by "delete_volume" :: held 0.894s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:29 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Created reservations ['7c1da22b-ff79-4d53-babe-f26a7ab3f1f8', '7f620335-baeb-4830-8315-1464d2ac5c6e', '41259c0c-fec3-41ac-9b74-092d2fcce9b5', '42bc801f-1ee5-41c6-b5c2-65e6b1380eb6'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:27:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:29 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:27:29 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:29 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.299s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:29 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:27:29 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Deleted volume successfully. Jul 23 22:27:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-22fd699d-052d-4e36-9124-4b547d3f5bd3 tempest-VolumesMetadataTest-1894329730 None] Lock "cinder-afc9bd75-8c13-4870-9a74-2929cccd5d17-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:30 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:27:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Flow 'volume_create_manager' (cee26e37-a232-4471-aed9-638735173b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21af6c50-6361-4f91-9b86-d479376939f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21af6c50-6361-4f91-9b86-d479376939f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1316921432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87729346-1cdd-464b-b3a6-9544dfa7912a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906962a6d701430c8cbd4e4b92d5230d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:31Z,use_quota=True,user_id='b437a4d6a1c44e218d6ce830832cfcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955fc06a-a82f-4a90-8115-51b4475aefe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955fc06a-a82f-4a90-8115-51b4475aefe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebf0105-d228-4eab-8ffd-23707ba4366f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:30 devstack cinder-volume[88308]: DEBUG cinder.image.glance [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Creating Keystone auth plugin from conf {{(pid=88308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 22:27:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebf0105-d228-4eab-8ffd-23707ba4366f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87729346-1cdd-464b-b3a6-9544dfa7912a', 'volume_name': 'volume-87729346-1cdd-464b-b3a6-9544dfa7912a', 'volume_size': 1, 'image_id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73edeb14970041b0969b3a5428a796ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'created_at': datetime.datetime(2026, 7, 23, 20, 14, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79e9d1bf-6470-4134-adab-55462317ad8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9bbbda-2d7f-4c9e-bec8-37bfc61a64a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9bbbda-2d7f-4c9e-bec8-37bfc61a64a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf1a6d8d-951b-46c4-bd80-f61529769d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:31 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Volume 87729346-1cdd-464b-b3a6-9544dfa7912a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87729346-1cdd-464b-b3a6-9544dfa7912a', 'volume_size': 1, 'image_id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73edeb14970041b0969b3a5428a796ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'created_at': datetime.datetime(2026, 7, 23, 20, 14, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79e9d1bf-6470-4134-adab-55462317ad8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 22:27:31 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Trying to clone 87729346-1cdd-464b-b3a6-9544dfa7912a from image 79e9d1bf-6470-4134-adab-55462317ad8b at location (None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}]). {{(pid=88308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 22:27:31 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_xmjssfa8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 22:27:31 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Image download 20.69 MB at 20.69 MB/s Jul 23 22:27:31 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[857d5e50-a2c6-4107-bc84-6ed1ecbcc7ee]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_xmjssfa8devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:31 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_xmjssfa8devstack@QuobyteHD Jul 23 22:27:32 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:32 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_xmjssfa8devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:32 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Temporary image 79e9d1bf-6470-4134-adab-55462317ad8b is fetched for user b437a4d6a1c44e218d6ce830832cfcf4. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 22:27:32 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d018ad-32ea-4118-8d9d-256c3575f4af]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_xmjssfa8devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:32 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_xmjssfa8devstack@QuobyteHD Jul 23 22:27:32 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:32 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_xmjssfa8devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1316921432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87729346-1cdd-464b-b3a6-9544dfa7912a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906962a6d701430c8cbd4e4b92d5230d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:31Z,use_quota=True,user_id='b437a4d6a1c44e218d6ce830832cfcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:27:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Creating volume 87729346-1cdd-464b-b3a6-9544dfa7912a {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:27:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:27:32 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:27:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:32 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a 1073741824 Jul 23 22:27:32 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:33 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a 1073741824" returned: 0 in 0.531s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:33 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a Jul 23 22:27:33 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:33 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a" returned: 0 in 0.295s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:27:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:33 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Attempting download of 79e9d1bf-6470-4134-adab-55462317ad8b ((None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}])) to volume 87729346-1cdd-464b-b3a6-9544dfa7912a. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 22:27:33 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[526d9a70-d8c3-48aa-8e86-10012c06331b]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_5dyvu0ws {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:33 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_5dyvu0ws Jul 23 22:27:33 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:34 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_5dyvu0ws" returned: 0 in 0.397s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_5dyvu0ws {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:34 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_5dyvu0ws Jul 23 22:27:34 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:34 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_5dyvu0ws" returned: 1 in 0.367s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_5dyvu0ws' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9907c57a-1819-4b28-a914-836f8eefc0af]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_xmjssfa8devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:34 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_xmjssfa8devstack@QuobyteHD Jul 23 22:27:34 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:34 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_xmjssfa8devstack@QuobyteHD" returned: 0 in 0.406s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] 79e9d1bf-6470-4134-adab-55462317ad8b was qcow2, converting to raw {{(pid=88308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_xmjssfa8devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:34 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_xmjssfa8devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a Jul 23 22:27:34 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Flow 'volume_create_manager' (1d9a7f45-589d-4b0b-af48-4d48c31a8be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707671c9-afcf-4aa0-bc42-3967135360d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707671c9-afcf-4aa0-bc42-3967135360d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2022117161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa66cab-b67e-4119-b5a6-51edef2c4ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d87e4917694e799d1399a68f07b7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:35Z,use_quota=True,user_id='684d357e90ae4595950822314133445f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac6842d-9bd3-4a54-ba4f-18c52b533913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac6842d-9bd3-4a54-ba4f-18c52b533913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd653e7-e69d-40f4-8e0b-2845a33b7be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd653e7-e69d-40f4-8e0b-2845a33b7be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aa66cab-b67e-4119-b5a6-51edef2c4ee8', 'volume_name': 'volume-8aa66cab-b67e-4119-b5a6-51edef2c4ee8', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c52ff54-b7b9-497b-80c5-8a5724a4e352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c52ff54-b7b9-497b-80c5-8a5724a4e352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee59c32-03bc-44f2-aaf0-6db53da77128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:34 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Volume 8aa66cab-b67e-4119-b5a6-51edef2c4ee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aa66cab-b67e-4119-b5a6-51edef2c4ee8', 'volume_size': 1} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2022117161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa66cab-b67e-4119-b5a6-51edef2c4ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d87e4917694e799d1399a68f07b7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:35Z,use_quota=True,user_id='684d357e90ae4595950822314133445f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Creating volume 8aa66cab-b67e-4119-b5a6-51edef2c4ee8 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:27:35 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8aa66cab-b67e-4119-b5a6-51edef2c4ee8 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:35 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8aa66cab-b67e-4119-b5a6-51edef2c4ee8 1073741824 Jul 23 22:27:35 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:35 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8aa66cab-b67e-4119-b5a6-51edef2c4ee8 1073741824" returned: 0 in 0.545s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8aa66cab-b67e-4119-b5a6-51edef2c4ee8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:35 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8aa66cab-b67e-4119-b5a6-51edef2c4ee8 Jul 23 22:27:35 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:35 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8aa66cab-b67e-4119-b5a6-51edef2c4ee8" returned: 0 in 0.292s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee59c32-03bc-44f2-aaf0-6db53da77128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aa66cab-b67e-4119-b5a6-51edef2c4ee8', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e5b90e-464a-484b-aae3-bcbdf4375fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:35 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Volume volume-8aa66cab-b67e-4119-b5a6-51edef2c4ee8 (8aa66cab-b67e-4119-b5a6-51edef2c4ee8): created successfully Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e5b90e-464a-484b-aae3-bcbdf4375fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Flow 'volume_create_manager' (1d9a7f45-589d-4b0b-af48-4d48c31a8be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:35 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-11e2cace-749c-4525-9b7d-430313f9199b tempest-VolumesTransfersTest-1692950426 None] Created volume successfully. Jul 23 22:27:36 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_xmjssfa8devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a" returned: 0 in 1.733s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:36 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_xmjssfa8devstack@QuobyteHD, size 112.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:27:36 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Converted 112.00 MB image at 64.54 MB/s Jul 23 22:27:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:36 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a 1G Jul 23 22:27:36 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:36 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a 1G" returned: 0 in 0.340s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:37 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00acad1-18f9-432a-95cd-b7669e4d1e0d]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:37 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a Jul 23 22:27:37 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:37 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a" returned: 0 in 0.461s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:37 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a Jul 23 22:27:37 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:37 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a" returned: 1 in 0.408s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:27:37 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Downloaded image 79e9d1bf-6470-4134-adab-55462317ad8b ((None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}])) to volume 87729346-1cdd-464b-b3a6-9544dfa7912a successfully. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 22:27:37 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Temporary image 79e9d1bf-6470-4134-adab-55462317ad8b for user b437a4d6a1c44e218d6ce830832cfcf4 is deleted. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 22:27:37 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Marking volume 87729346-1cdd-464b-b3a6-9544dfa7912a as bootable. {{(pid=88308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 22:27:37 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Copying metadata from image 79e9d1bf-6470-4134-adab-55462317ad8b to 87729346-1cdd-464b-b3a6-9544dfa7912a. {{(pid=88308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 22:27:37 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Creating volume glance metadata for volume 87729346-1cdd-464b-b3a6-9544dfa7912a backed by image 79e9d1bf-6470-4134-adab-55462317ad8b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 22:27:37 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-73b852c2-f967-40c8-a180-1d739e850cd3 tempest-VolumesTransfersTest-895225534 None] Transfer volume completed successfully. Jul 23 22:27:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf1a6d8d-951b-46c4-bd80-f61529769d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87729346-1cdd-464b-b3a6-9544dfa7912a', 'volume_size': 1, 'image_id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73edeb14970041b0969b3a5428a796ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'created_at': datetime.datetime(2026, 7, 23, 20, 14, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79e9d1bf-6470-4134-adab-55462317ad8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d19a51b-aa09-4d13-b8f4-7133ab3bae2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:38 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Volume volume-87729346-1cdd-464b-b3a6-9544dfa7912a (87729346-1cdd-464b-b3a6-9544dfa7912a): created successfully Jul 23 22:27:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d19a51b-aa09-4d13-b8f4-7133ab3bae2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Flow 'volume_create_manager' (cee26e37-a232-4471-aed9-638735173b1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:38 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-3e398fad-ff30-4572-b4f4-eca281662daf tempest-VolumesExtendTest-688209687 None] Created volume successfully. Jul 23 22:27:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ece217c9-4d9d-4c1f-bb63-a9733dbab1d2 tempest-VolumesExtendTest-688209687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ece217c9-4d9d-4c1f-bb63-a9733dbab1d2 tempest-VolumesExtendTest-688209687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:38 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abd3298-fb9b-49d2-8d92-269dc1037b48]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ece217c9-4d9d-4c1f-bb63-a9733dbab1d2 tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:38 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a Jul 23 22:27:38 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Acquiring lock "cinder-8aa66cab-b67e-4119-b5a6-51edef2c4ee8-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Lock "cinder-8aa66cab-b67e-4119-b5a6-51edef2c4ee8-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Acquiring lock "cinder-quobyte-8aa66cab-b67e-4119-b5a6-51edef2c4ee8" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Lock "cinder-quobyte-8aa66cab-b67e-4119-b5a6-51edef2c4ee8" acquired by "delete_volume" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:38 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9e751e-4ac6-46ba-8f4b-82efe9529070]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8aa66cab-b67e-4119-b5a6-51edef2c4ee8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:39 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ece217c9-4d9d-4c1f-bb63-a9733dbab1d2 tempest-VolumesExtendTest-688209687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a" returned: 0 in 0.476s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ece217c9-4d9d-4c1f-bb63-a9733dbab1d2 tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:39 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8aa66cab-b67e-4119-b5a6-51edef2c4ee8 Jul 23 22:27:39 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:39 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a Jul 23 22:27:39 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:39 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8aa66cab-b67e-4119-b5a6-51edef2c4ee8" returned: 0 in 0.541s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8aa66cab-b67e-4119-b5a6-51edef2c4ee8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:39 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ece217c9-4d9d-4c1f-bb63-a9733dbab1d2 tempest-VolumesExtendTest-688209687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a" returned: 1 in 0.437s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ece217c9-4d9d-4c1f-bb63-a9733dbab1d2 tempest-VolumesExtendTest-688209687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:27:39 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8aa66cab-b67e-4119-b5a6-51edef2c4ee8 Jul 23 22:27:39 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ece217c9-4d9d-4c1f-bb63-a9733dbab1d2 tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a 2G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ece217c9-4d9d-4c1f-bb63-a9733dbab1d2 tempest-VolumesExtendTest-688209687 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a 2G" returned: 0 in 0.070s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ece217c9-4d9d-4c1f-bb63-a9733dbab1d2 tempest-VolumesExtendTest-688209687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.036s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:39 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ece217c9-4d9d-4c1f-bb63-a9733dbab1d2 tempest-VolumesExtendTest-688209687 None] Extend volume completed successfully. Jul 23 22:27:39 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8aa66cab-b67e-4119-b5a6-51edef2c4ee8" returned: 0 in 0.277s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Lock "cinder-quobyte-8aa66cab-b67e-4119-b5a6-51edef2c4ee8" released by "delete_volume" :: held 0.881s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Created reservations ['c1e7a783-2cb7-446b-9d28-394acc8e66d5', 'ee3c9437-ea32-4bba-9d25-744523c3ee2d', 'fd34c1c2-b601-4faa-8a50-f17b6a1a6340', '3149532e-9312-4b0d-b75a-4fbfc73dd9dc'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:39 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:27:39 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:40 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.266s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:40 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:27:40 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Deleted volume successfully. Jul 23 22:27:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-86bbe22a-5cd3-437e-9099-4f9ace340b2d tempest-VolumesTransfersTest-1660816306 None] Lock "cinder-8aa66cab-b67e-4119-b5a6-51edef2c4ee8-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Acquiring lock "cinder-87729346-1cdd-464b-b3a6-9544dfa7912a-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Lock "cinder-87729346-1cdd-464b-b3a6-9544dfa7912a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Acquiring lock "cinder-quobyte-87729346-1cdd-464b-b3a6-9544dfa7912a" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Lock "cinder-quobyte-87729346-1cdd-464b-b3a6-9544dfa7912a" acquired by "delete_volume" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51ce376-4c08-4f2c-8795-4cd68f1014ea]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:41 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a Jul 23 22:27:41 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:41 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a" returned: 0 in 0.471s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Flow 'volume_create_manager' (3d46a860-84a7-4cfd-b670-46bb7d02918d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3f6317-415a-4fd9-a603-c50ad368b5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3f6317-415a-4fd9-a603-c50ad368b5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-87718926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc4b062-0a20-4607-8072-febd7b3aedd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d87e4917694e799d1399a68f07b7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:42Z,use_quota=True,user_id='684d357e90ae4595950822314133445f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (270cb6bc-76cd-4fdf-b9e1-cf201aa57853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:41 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a Jul 23 22:27:41 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (270cb6bc-76cd-4fdf-b9e1-cf201aa57853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e552080a-37fe-4727-977a-d464b04fb9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e552080a-37fe-4727-977a-d464b04fb9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bc4b062-0a20-4607-8072-febd7b3aedd1', 'volume_name': 'volume-1bc4b062-0a20-4607-8072-febd7b3aedd1', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3d1d91-e691-48f9-9da9-6f858815bc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3d1d91-e691-48f9-9da9-6f858815bc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bb1c6e-ba8d-48ff-a416-6ec27c606ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:41 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Volume 1bc4b062-0a20-4607-8072-febd7b3aedd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bc4b062-0a20-4607-8072-febd7b3aedd1', 'volume_size': 1} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-87718926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc4b062-0a20-4607-8072-febd7b3aedd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d87e4917694e799d1399a68f07b7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:42Z,use_quota=True,user_id='684d357e90ae4595950822314133445f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Creating volume 1bc4b062-0a20-4607-8072-febd7b3aedd1 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:27:41 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:27:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1bc4b062-0a20-4607-8072-febd7b3aedd1 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:41 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1bc4b062-0a20-4607-8072-febd7b3aedd1 1073741824 Jul 23 22:27:41 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:41 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a" returned: 1 in 0.400s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:42 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a Jul 23 22:27:42 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:42 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1bc4b062-0a20-4607-8072-febd7b3aedd1 1073741824" returned: 0 in 0.530s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1bc4b062-0a20-4607-8072-febd7b3aedd1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:42 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-87729346-1cdd-464b-b3a6-9544dfa7912a" returned: 0 in 0.339s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Lock "cinder-quobyte-87729346-1cdd-464b-b3a6-9544dfa7912a" released by "delete_volume" :: held 1.296s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:42 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1bc4b062-0a20-4607-8072-febd7b3aedd1 Jul 23 22:27:42 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Created reservations ['30c9bc12-a923-4e3d-8a24-71f3baa24e81', '51bd9b23-253b-4298-976e-78f02396086f', '67acb682-0c00-46de-93cc-4f2f5e6241f9', 'd38b24ed-523d-4a48-8196-3967a98052c6'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:42 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:27:42 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:42 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1bc4b062-0a20-4607-8072-febd7b3aedd1" returned: 0 in 0.309s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bb1c6e-ba8d-48ff-a416-6ec27c606ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bc4b062-0a20-4607-8072-febd7b3aedd1', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0466b30e-20fd-41cd-8aea-f3d53de9cd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:42 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Volume volume-1bc4b062-0a20-4607-8072-febd7b3aedd1 (1bc4b062-0a20-4607-8072-febd7b3aedd1): created successfully Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0466b30e-20fd-41cd-8aea-f3d53de9cd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Flow 'volume_create_manager' (3d46a860-84a7-4cfd-b670-46bb7d02918d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:42 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-234232f1-acb2-4a6c-ad23-99b0dd7a94d3 tempest-VolumesTransfersTest-1692950426 None] Created volume successfully. Jul 23 22:27:42 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.304s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:27:42 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Deleted volume successfully. Jul 23 22:27:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-32f45c2a-ae68-490b-8a1a-d4d0087f35ae tempest-VolumesExtendTest-688209687 None] Lock "cinder-87729346-1cdd-464b-b3a6-9544dfa7912a-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Flow 'volume_create_manager' (24b90ea7-d588-481d-8995-ccdd61ca68b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cae168-d821-4bc4-a988-26728d017f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cae168-d821-4bc4-a988-26728d017f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-349509867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb14e181-ab49-48a7-befd-c31a2806f2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66965df715f468cabd95bed46d8b01e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:43Z,use_quota=True,user_id='50d81bff5eeb43728af8641f16b77916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b579a308-dbbe-45bb-a30b-b04a12099ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b579a308-dbbe-45bb-a30b-b04a12099ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cbaba1-1cb4-4351-8c29-d0c873b68c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cbaba1-1cb4-4351-8c29-d0c873b68c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb14e181-ab49-48a7-befd-c31a2806f2dd', 'volume_name': 'volume-cb14e181-ab49-48a7-befd-c31a2806f2dd', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee53ff8-6bdb-4a78-ae00-0a258409c8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee53ff8-6bdb-4a78-ae00-0a258409c8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfd710a-f3ff-427e-a7f8-fb2727f00cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:43 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Volume cb14e181-ab49-48a7-befd-c31a2806f2dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb14e181-ab49-48a7-befd-c31a2806f2dd', 'volume_size': 1} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-349509867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb14e181-ab49-48a7-befd-c31a2806f2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66965df715f468cabd95bed46d8b01e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:43Z,use_quota=True,user_id='50d81bff5eeb43728af8641f16b77916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Creating volume cb14e181-ab49-48a7-befd-c31a2806f2dd {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:27:43 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb14e181-ab49-48a7-befd-c31a2806f2dd 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:43 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb14e181-ab49-48a7-befd-c31a2806f2dd 1073741824 Jul 23 22:27:43 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Flow 'volume_create_manager' (ccc35de9-a0c4-4c84-bd18-f4c96ed7eef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c442c34f-4c2e-42e4-a0d7-b6b205be9e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c442c34f-4c2e-42e4-a0d7-b6b205be9e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2108310286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159ce5e0-6ebc-4c39-9311-1d8c978bc63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906962a6d701430c8cbd4e4b92d5230d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:44Z,use_quota=True,user_id='b437a4d6a1c44e218d6ce830832cfcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e13aa3-2694-4e39-a701-79db44954e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e13aa3-2694-4e39-a701-79db44954e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048e06fc-28d2-43df-96bf-029ef95e5c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048e06fc-28d2-43df-96bf-029ef95e5c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '159ce5e0-6ebc-4c39-9311-1d8c978bc63c', 'volume_name': 'volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7e7adc-1bd2-46f5-87f6-f27c7934b27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7e7adc-1bd2-46f5-87f6-f27c7934b27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7696fdc2-2915-4cd7-90ef-37f5fc714631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:43 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Volume 159ce5e0-6ebc-4c39-9311-1d8c978bc63c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c', 'volume_size': 1} Jul 23 22:27:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:43 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb14e181-ab49-48a7-befd-c31a2806f2dd 1073741824" returned: 0 in 0.573s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb14e181-ab49-48a7-befd-c31a2806f2dd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:27:44 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb14e181-ab49-48a7-befd-c31a2806f2dd Jul 23 22:27:44 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Flow 'volume_create_manager' (63a73e0a-bb06-4862-a31a-f0638c5a80ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97cef241-c644-4c63-96bc-08d864dd2d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97cef241-c644-4c63-96bc-08d864dd2d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-279540618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1880e1-bbfb-446d-95e2-d63e8e2f60b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d2cb6bb8e243dd803b4ae27a25e3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:44Z,use_quota=True,user_id='b86834a71fe84f8e8fd40710119f724e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40af1509-cb48-47ce-bf6a-278f563221f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40af1509-cb48-47ce-bf6a-278f563221f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b9af98-b631-4979-a104-528de6006019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b9af98-b631-4979-a104-528de6006019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc1880e1-bbfb-446d-95e2-d63e8e2f60b5', 'volume_name': 'volume-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffec44d5-f9da-487b-8755-b5cc760a0ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffec44d5-f9da-487b-8755-b5cc760a0ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d686e70-9a0a-43d9-833f-929357434733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:44 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Volume fc1880e1-bbfb-446d-95e2-d63e8e2f60b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5', 'volume_size': 1} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Acquiring lock "cinder-1bc4b062-0a20-4607-8072-febd7b3aedd1-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Lock "cinder-1bc4b062-0a20-4607-8072-febd7b3aedd1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Acquiring lock "cinder-quobyte-1bc4b062-0a20-4607-8072-febd7b3aedd1" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Lock "cinder-quobyte-1bc4b062-0a20-4607-8072-febd7b3aedd1" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cf32c3-b969-4c91-8336-18621e35afc1]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1bc4b062-0a20-4607-8072-febd7b3aedd1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:44 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb14e181-ab49-48a7-befd-c31a2806f2dd" returned: 0 in 0.281s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.407s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2108310286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159ce5e0-6ebc-4c39-9311-1d8c978bc63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='906962a6d701430c8cbd4e4b92d5230d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:44Z,use_quota=True,user_id='b437a4d6a1c44e218d6ce830832cfcf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Creating volume 159ce5e0-6ebc-4c39-9311-1d8c978bc63c {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:27:44 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfd710a-f3ff-427e-a7f8-fb2727f00cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb14e181-ab49-48a7-befd-c31a2806f2dd', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:44 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c 1073741824 Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f15c84-5d68-4d63-ae89-fbf3c4206619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:44 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:44 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Volume volume-cb14e181-ab49-48a7-befd-c31a2806f2dd (cb14e181-ab49-48a7-befd-c31a2806f2dd): created successfully Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f15c84-5d68-4d63-ae89-fbf3c4206619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:44 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1bc4b062-0a20-4607-8072-febd7b3aedd1 Jul 23 22:27:44 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Flow 'volume_create_manager' (24b90ea7-d588-481d-8995-ccdd61ca68b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:44 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f7a6bf07-31a7-4ed2-b1c5-2a49261e313b tempest-AttachVolumeNegativeTest-577220995 None] Created volume successfully. Jul 23 22:27:44 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1bc4b062-0a20-4607-8072-febd7b3aedd1" returned: 0 in 0.377s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1bc4b062-0a20-4607-8072-febd7b3aedd1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:44 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1bc4b062-0a20-4607-8072-febd7b3aedd1 Jul 23 22:27:44 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:44 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c 1073741824" returned: 0 in 0.422s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:44 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c Jul 23 22:27:44 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:44 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1bc4b062-0a20-4607-8072-febd7b3aedd1" returned: 0 in 0.262s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Lock "cinder-quobyte-1bc4b062-0a20-4607-8072-febd7b3aedd1" released by "delete_volume" :: held 0.698s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Created reservations ['c20845a7-7606-4421-971f-b035fffe568c', '9d3b3f19-828c-4fc6-a33f-ace5779c5a37', '1da5ec5f-8d42-45ae-9f00-b3efe4856de4', 'e1e7c1b1-6cbb-4237-a9a2-5f6726c6d4df'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:27:45 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c" returned: 0 in 0.257s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.908s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-279540618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1880e1-bbfb-446d-95e2-d63e8e2f60b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d2cb6bb8e243dd803b4ae27a25e3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:44Z,use_quota=True,user_id='b86834a71fe84f8e8fd40710119f724e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Creating volume fc1880e1-bbfb-446d-95e2-d63e8e2f60b5 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:27:45 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:45 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5 1073741824 Jul 23 22:27:45 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7696fdc2-2915-4cd7-90ef-37f5fc714631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afb7878-49a3-4600-a054-86ebe14b7881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:45 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Volume volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c (159ce5e0-6ebc-4c39-9311-1d8c978bc63c): created successfully Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afb7878-49a3-4600-a054-86ebe14b7881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Flow 'volume_create_manager' (ccc35de9-a0c4-4c84-bd18-f4c96ed7eef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:45 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:27:45 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:45 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-21b06ae8-c1c8-470c-b3b4-bcc1fc37daf5 tempest-VolumesExtendTest-688209687 None] Created volume successfully. Jul 23 22:27:45 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.310s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:27:45 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Deleted volume successfully. Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4229ac01-f023-4040-abee-2348fe4be672 tempest-VolumesTransfersTest-1660816306 None] Lock "cinder-1bc4b062-0a20-4607-8072-febd7b3aedd1-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:45 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5 1073741824" returned: 0 in 0.564s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:45 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5 Jul 23 22:27:45 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:45 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5" returned: 0 in 0.318s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:27:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d686e70-9a0a-43d9-833f-929357434733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d13b8b-ad5a-4b51-ac98-70b00eac51fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:46 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Volume volume-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5 (fc1880e1-bbfb-446d-95e2-d63e8e2f60b5): created successfully Jul 23 22:27:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d13b8b-ad5a-4b51-ac98-70b00eac51fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Flow 'volume_create_manager' (63a73e0a-bb06-4862-a31a-f0638c5a80ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] Creating offline snapshot 53637497-7f97-4be6-84df-d6c0ba581d9a of volume 159ce5e0-6ebc-4c39-9311-1d8c978bc63c {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:27:46 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-703cfe6a-b042-4ba9-9a43-fca7b17eaf90 tempest-VolumesListAdminTestJSON-210370417 None] Created volume successfully. Jul 23 22:27:46 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e40363-89a6-4a8b-bf9e-8b5fa1594c98]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:46 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c Jul 23 22:27:46 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-98c4961e-79bb-4618-80eb-327b7a1b37ef req-f44f61c7-37af-481a-9123-f8015d736ce9 tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:46 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c" returned: 0 in 0.413s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:46 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a 1G Jul 23 22:27:46 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:47 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a 1G" returned: 0 in 0.449s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:47 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a Jul 23 22:27:47 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:47 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a" returned: 0 in 0.341s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:47 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a is being set with open permissions: ugo+rw Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:47 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a Jul 23 22:27:47 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:47 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a" returned: 0 in 0.343s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:47 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.info Jul 23 22:27:47 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Flow 'volume_create_manager' (27a98c35-1409-4e35-9f05-7b77d650d917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89e6328-1d6b-4d3b-b66f-51c155c21086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89e6328-1d6b-4d3b-b66f-51c155c21086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-159691343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107eedc4-bbce-4422-97db-ba1863950eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d2cb6bb8e243dd803b4ae27a25e3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:48Z,use_quota=True,user_id='b86834a71fe84f8e8fd40710119f724e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (affc68ab-c538-4989-86e3-57893821cf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (affc68ab-c538-4989-86e3-57893821cf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d985a40c-5dc5-4416-9737-b068548091fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d985a40c-5dc5-4416-9737-b068548091fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '107eedc4-bbce-4422-97db-ba1863950eca', 'volume_name': 'volume-107eedc4-bbce-4422-97db-ba1863950eca', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733409c2-92f2-40c0-bd40-95f095963738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733409c2-92f2-40c0-bd40-95f095963738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f9a9a3-93ae-4155-8c83-58ba69b44b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:47 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Volume 107eedc4-bbce-4422-97db-ba1863950eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-107eedc4-bbce-4422-97db-ba1863950eca', 'volume_size': 1} Jul 23 22:27:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:48 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.info" returned: 0 in 0.282s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:48 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.info is being set with open permissions: ugo+rw Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:48 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.info Jul 23 22:27:48 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:48 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.info" returned: 0 in 0.271s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-98c4961e-79bb-4618-80eb-327b7a1b37ef req-f44f61c7-37af-481a-9123-f8015d736ce9 tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.961s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15d3aad-ca25-472e-bd87-2ab62f1182aa]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-98c4961e-79bb-4618-80eb-327b7a1b37ef req-f44f61c7-37af-481a-9123-f8015d736ce9 tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb14e181-ab49-48a7-befd-c31a2806f2dd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:48 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c4fd024b-9926-4a8d-b7ac-ce3d3fd6febb tempest-VolumesExtendTest-688209687 None] Create snapshot completed successfully Jul 23 22:27:48 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb14e181-ab49-48a7-befd-c31a2806f2dd Jul 23 22:27:48 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:48 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-98c4961e-79bb-4618-80eb-327b7a1b37ef req-f44f61c7-37af-481a-9123-f8015d736ce9 tempest-AttachVolumeNegativeTest-577220995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb14e181-ab49-48a7-befd-c31a2806f2dd" returned: 0 in 0.399s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-98c4961e-79bb-4618-80eb-327b7a1b37ef req-f44f61c7-37af-481a-9123-f8015d736ce9 tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.416s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-159691343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107eedc4-bbce-4422-97db-ba1863950eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d2cb6bb8e243dd803b4ae27a25e3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:48Z,use_quota=True,user_id='b86834a71fe84f8e8fd40710119f724e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Creating volume 107eedc4-bbce-4422-97db-ba1863950eca {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:27:48 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-107eedc4-bbce-4422-97db-ba1863950eca 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:48 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-107eedc4-bbce-4422-97db-ba1863950eca 1073741824 Jul 23 22:27:48 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-98c4961e-79bb-4618-80eb-327b7a1b37ef req-f44f61c7-37af-481a-9123-f8015d736ce9 tempest-AttachVolumeNegativeTest-577220995 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-cb14e181-ab49-48a7-befd-c31a2806f2dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a728a8d-b94e-4ce1-8cca-ef838ada9925', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:27:48 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-98c4961e-79bb-4618-80eb-327b7a1b37ef req-f44f61c7-37af-481a-9123-f8015d736ce9 tempest-AttachVolumeNegativeTest-577220995 None] attachment_update completed successfully. Jul 23 22:27:49 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7fd2a320-7d76-4961-aef2-91f8f7efb384 tempest-VolumesExtendTest-688209687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-107eedc4-bbce-4422-97db-ba1863950eca 1073741824" returned: 0 in 0.620s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-107eedc4-bbce-4422-97db-ba1863950eca {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:49 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-107eedc4-bbce-4422-97db-ba1863950eca Jul 23 22:27:49 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:49 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-107eedc4-bbce-4422-97db-ba1863950eca" returned: 0 in 0.286s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:27:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7fd2a320-7d76-4961-aef2-91f8f7efb384 tempest-VolumesExtendTest-688209687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.359s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f9a9a3-93ae-4155-8c83-58ba69b44b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-107eedc4-bbce-4422-97db-ba1863950eca', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a3f3cb-e874-4498-972a-754362ff607a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:49 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[500003af-083f-4ac5-80f2-c599d39052a3]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7fd2a320-7d76-4961-aef2-91f8f7efb384 tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:49 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Volume volume-107eedc4-bbce-4422-97db-ba1863950eca (107eedc4-bbce-4422-97db-ba1863950eca): created successfully Jul 23 22:27:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a3f3cb-e874-4498-972a-754362ff607a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Flow 'volume_create_manager' (27a98c35-1409-4e35-9f05-7b77d650d917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:49 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-19caf6cc-5fca-48d7-838a-7b3355ff3727 tempest-VolumesListAdminTestJSON-210370417 None] Created volume successfully. Jul 23 22:27:50 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c Jul 23 22:27:50 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:50 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7fd2a320-7d76-4961-aef2-91f8f7efb384 tempest-VolumesExtendTest-688209687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c" returned: 0 in 0.425s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7fd2a320-7d76-4961-aef2-91f8f7efb384 tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a 2G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7fd2a320-7d76-4961-aef2-91f8f7efb384 tempest-VolumesExtendTest-688209687 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a 2G" returned: 0 in 0.132s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7fd2a320-7d76-4961-aef2-91f8f7efb384 tempest-VolumesExtendTest-688209687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.647s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:50 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-7fd2a320-7d76-4961-aef2-91f8f7efb384 tempest-VolumesExtendTest-688209687 None] Extend volume completed successfully. Jul 23 22:27:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Acquiring lock "cinder-53637497-7f97-4be6-84df-d6c0ba581d9a-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Lock "cinder-53637497-7f97-4be6-84df-d6c0ba581d9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Acquiring lock "cinder-quobyte-159ce5e0-6ebc-4c39-9311-1d8c978bc63c" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Lock "cinder-quobyte-159ce5e0-6ebc-4c39-9311-1d8c978bc63c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Acquiring lock "cinder-quobyte-53637497-7f97-4be6-84df-d6c0ba581d9a" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Lock "cinder-quobyte-53637497-7f97-4be6-84df-d6c0ba581d9a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Deleting offline snapshot 53637497-7f97-4be6-84df-d6c0ba581d9a of volume 159ce5e0-6ebc-4c39-9311-1d8c978bc63c {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:27:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] snapshot_file for this snap is: volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:27:50 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[db65ed75-4d79-4f08-a415-97c83e3071de]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:50 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a Jul 23 22:27:50 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:51 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a" returned: 0 in 0.520s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:51 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:27:51 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f45a9b-40e0-4fee-b930-1a27028d8ec8]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:51 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c Jul 23 22:27:51 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:51 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c" returned: 0 in 0.462s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:51 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a Jul 23 22:27:51 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:51 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:DELETE=16,cinder:UPDATE=134,cinder:SELECT=110,cinder:INSERT=34 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:27:51 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=110,cinder:UPDATE=140,cinder:DELETE=9,cinder:INSERT=34 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:27:51 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:27:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Flow 'volume_create_manager' (ec0156ce-505f-4731-a118-15fd0aceaad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d780595-c47b-4eb3-948f-5c6f14fd2d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d780595-c47b-4eb3-948f-5c6f14fd2d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1225615906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29771903-164f-46e3-a0b0-b0b10e858d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d2cb6bb8e243dd803b4ae27a25e3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:52Z,use_quota=True,user_id='b86834a71fe84f8e8fd40710119f724e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaed5058-3dce-4fbd-91c3-a04ed702577f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaed5058-3dce-4fbd-91c3-a04ed702577f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ba0616-4187-487b-990f-0be6462a8b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ba0616-4187-487b-990f-0be6462a8b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29771903-164f-46e3-a0b0-b0b10e858d01', 'volume_name': 'volume-29771903-164f-46e3-a0b0-b0b10e858d01', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e43c31-b2fb-4b0c-b350-abe333ac4064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e43c31-b2fb-4b0c-b350-abe333ac4064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc075ae-73a1-4f1b-83ff-e1c1bb69ce80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:52 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Volume 29771903-164f-46e3-a0b0-b0b10e858d01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29771903-164f-46e3-a0b0-b0b10e858d01', 'volume_size': 1} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1225615906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29771903-164f-46e3-a0b0-b0b10e858d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d2cb6bb8e243dd803b4ae27a25e3ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:52Z,use_quota=True,user_id='b86834a71fe84f8e8fd40710119f724e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Creating volume 29771903-164f-46e3-a0b0-b0b10e858d01 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:27:52 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-29771903-164f-46e3-a0b0-b0b10e858d01 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:52 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-29771903-164f-46e3-a0b0-b0b10e858d01 1073741824 Jul 23 22:27:52 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Flow 'volume_create_manager' (e990df7d-8bac-4010-bc60-6d492d9e1ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e8686c-194d-438e-a786-e4125949b0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e8686c-194d-438e-a786-e4125949b0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1505333070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3ffca8-c79c-4f8c-a226-6a500b4313cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86114a0265f34074a7fdd3790155c8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:52Z,use_quota=True,user_id='c2c1c68771f8469888e714a083cb3c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f88941-1967-4a05-b9dd-44e610655146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f88941-1967-4a05-b9dd-44e610655146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d5dd0d-5514-4664-a4a3-c5dd64833442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d5dd0d-5514-4664-a4a3-c5dd64833442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa3ffca8-c79c-4f8c-a226-6a500b4313cf', 'volume_name': 'volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0851aa-4df4-4a3d-9572-6caebbba82f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0851aa-4df4-4a3d-9572-6caebbba82f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2754ed3-e695-43fc-a025-0f5c764abe90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:52 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Volume aa3ffca8-c79c-4f8c-a226-6a500b4313cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf', 'volume_size': 1} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:52 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-2996dd9b-98b5-438d-b3f2-cef77d2374a6 req-4d6cd246-3742-4c68-9357-3e9c5a70125a tempest-AttachVolumeNegativeTest-577220995 None] Terminate volume connection completed successfully. Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-2996dd9b-98b5-438d-b3f2-cef77d2374a6 req-4d6cd246-3742-4c68-9357-3e9c5a70125a tempest-AttachVolumeNegativeTest-577220995 None] Deleting attachment 8a728a8d-b94e-4ce1-8cca-ef838ada9925. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:27:52 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a" returned: 0 in 0.452s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:52 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a Jul 23 22:27:52 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:52 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c.53637497-7f97-4be6-84df-d6c0ba581d9a" returned: 0 in 0.289s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:52 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-29771903-164f-46e3-a0b0-b0b10e858d01 1073741824" returned: 0 in 0.528s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Lock "cinder-quobyte-53637497-7f97-4be6-84df-d6c0ba581d9a" released by "_delete_snapshot" :: held 1.838s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Lock "cinder-quobyte-159ce5e0-6ebc-4c39-9311-1d8c978bc63c" released by "delete_snapshot" :: held 1.866s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-29771903-164f-46e3-a0b0-b0b10e858d01 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:52 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-29771903-164f-46e3-a0b0-b0b10e858d01 Jul 23 22:27:52 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Created reservations ['f6ce96ce-047a-4a58-8644-5b458d6c5dd2', '03b669a7-cfa9-40e7-9a09-587c22505eaa', '183a3a51-5a9a-44e6-8a79-c0147fd89acd', 'ef106a9c-2e87-46f0-b3b6-c2023f6289ee'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:27:52 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Delete snapshot completed successfully. Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-11ecb4fe-8a66-48ca-a580-590156eb7e4a tempest-VolumesExtendTest-688209687 None] Lock "cinder-53637497-7f97-4be6-84df-d6c0ba581d9a-delete_snapshot" released by "delete_snapshot" :: held 2.027s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:52 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-29771903-164f-46e3-a0b0-b0b10e858d01" returned: 0 in 0.301s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.699s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1505333070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3ffca8-c79c-4f8c-a226-6a500b4313cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86114a0265f34074a7fdd3790155c8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:52Z,use_quota=True,user_id='c2c1c68771f8469888e714a083cb3c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Creating volume aa3ffca8-c79c-4f8c-a226-6a500b4313cf {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:27:52 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:27:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Acquiring lock "cinder-159ce5e0-6ebc-4c39-9311-1d8c978bc63c-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:53 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf 1073741824 Jul 23 22:27:53 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc075ae-73a1-4f1b-83ff-e1c1bb69ce80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29771903-164f-46e3-a0b0-b0b10e858d01', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f36c6a-e5d8-4761-9329-e30ab1d13cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Lock "cinder-159ce5e0-6ebc-4c39-9311-1d8c978bc63c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:53 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Volume volume-29771903-164f-46e3-a0b0-b0b10e858d01 (29771903-164f-46e3-a0b0-b0b10e858d01): created successfully Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f36c6a-e5d8-4761-9329-e30ab1d13cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Flow 'volume_create_manager' (ec0156ce-505f-4731-a118-15fd0aceaad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:53 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e0f9daf6-0a5b-41b7-bac9-045300d4c726 tempest-VolumesListAdminTestJSON-210370417 None] Created volume successfully. Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Acquiring lock "cinder-quobyte-159ce5e0-6ebc-4c39-9311-1d8c978bc63c" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Lock "cinder-quobyte-159ce5e0-6ebc-4c39-9311-1d8c978bc63c" acquired by "delete_volume" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4568c849-055e-43ea-a87b-f77802ed29ac]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:53 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c Jul 23 22:27:53 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:53 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf 1073741824" returned: 0 in 0.441s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:53 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf Jul 23 22:27:53 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:53 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c" returned: 0 in 0.414s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:53 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c Jul 23 22:27:53 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:53 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf" returned: 0 in 0.267s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2754ed3-e695-43fc-a025-0f5c764abe90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a589be-0a5e-4950-8742-9f8e5469003e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:53 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Volume volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf (aa3ffca8-c79c-4f8c-a226-6a500b4313cf): created successfully Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a589be-0a5e-4950-8742-9f8e5469003e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Flow 'volume_create_manager' (e990df7d-8bac-4010-bc60-6d492d9e1ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:53 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-1f456afa-4ca3-4baf-810f-004db718a322 tempest-VolumesCloneTest-1019767357 None] Created volume successfully. Jul 23 22:27:53 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-159ce5e0-6ebc-4c39-9311-1d8c978bc63c" returned: 0 in 0.337s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Lock "cinder-quobyte-159ce5e0-6ebc-4c39-9311-1d8c978bc63c" released by "delete_volume" :: held 0.819s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:53 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Created reservations ['d713cd4d-d76a-4462-8955-2ea047fccbe5', '82f18051-70db-4f3e-9fa3-ed38d4775295', 'ba8cd3e7-c6c3-40fc-bf1e-d857378ab61a', '9e618795-4713-41cb-a8e7-cc7d065abe71'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:27:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:54 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:27:54 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:54 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.493s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:54 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:27:54 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Deleted volume successfully. Jul 23 22:27:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-39cdf537-6986-4eb8-930c-a7f40f605938 tempest-VolumesExtendTest-688209687 None] Lock "cinder-159ce5e0-6ebc-4c39-9311-1d8c978bc63c-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:27:54 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Flow 'volume_create_manager' (88e72fe7-02c6-4831-abaa-7dcc5ee5cb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6916ec23-e75d-4bd3-b303-6792fa381ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6916ec23-e75d-4bd3-b303-6792fa381ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1405108263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7648fbab-e273-4218-866c-a6a3e0636cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86114a0265f34074a7fdd3790155c8d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=aa3ffca8-c79c-4f8c-a226-6a500b4313cf,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:55Z,use_quota=True,user_id='c2c1c68771f8469888e714a083cb3c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b0e2c9-850d-451a-a3bd-08733ebc88c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b0e2c9-850d-451a-a3bd-08733ebc88c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67a81e5-8c82-46e6-bc00-0ff090f8123a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67a81e5-8c82-46e6-bc00-0ff090f8123a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7648fbab-e273-4218-866c-a6a3e0636cb3', 'volume_name': 'volume-7648fbab-e273-4218-866c-a6a3e0636cb3', 'volume_size': 2, 'source_volid': 'aa3ffca8-c79c-4f8c-a226-6a500b4313cf', 'source_volstatus': 'available'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6f2733-155c-4738-9562-de31af7ee829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6f2733-155c-4738-9562-de31af7ee829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834c6c27-1339-4373-939e-f2464e14f372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:55 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Volume 7648fbab-e273-4218-866c-a6a3e0636cb3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7648fbab-e273-4218-866c-a6a3e0636cb3', 'volume_size': 2, 'source_volid': 'aa3ffca8-c79c-4f8c-a226-6a500b4313cf', 'source_volstatus': 'available'} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:55 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Cloning volume aa3ffca8-c79c-4f8c-a226-6a500b4313cf to volume 7648fbab-e273-4218-866c-a6a3e0636cb3 Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Creating offline snapshot c3559cea-b67d-442f-b0d4-162c81d6fd83 of volume aa3ffca8-c79c-4f8c-a226-6a500b4313cf {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ac46b3-bd67-41b1-ade9-528a8fbc2068]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:55 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf Jul 23 22:27:55 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Flow 'volume_create_manager' (9565d730-fc1e-4454-9be7-7e3b4a51aaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be9fd6e-1353-40c9-9dfe-0f278833da24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be9fd6e-1353-40c9-9dfe-0f278833da24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b012b413-cf6f-437f-9cce-64ca3041c188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1e89febca94a69bfc9a37b1a8e2d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:55Z,use_quota=True,user_id='4411ddc1b8f04cabb90d76acd1156bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27504d2-f483-4265-9f05-3dcbd3332fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27504d2-f483-4265-9f05-3dcbd3332fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c89efb-06bc-487d-a730-03a2925b0320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c89efb-06bc-487d-a730-03a2925b0320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b012b413-cf6f-437f-9cce-64ca3041c188', 'volume_name': 'volume-b012b413-cf6f-437f-9cce-64ca3041c188', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b0737c-0d2a-4b00-af4a-4512e13597e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b0737c-0d2a-4b00-af4a-4512e13597e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4911af-39f4-446f-9673-5c94c5e46aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:55 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Volume b012b413-cf6f-437f-9cce-64ca3041c188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b012b413-cf6f-437f-9cce-64ca3041c188', 'volume_size': 1} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:55 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf" returned: 0 in 0.554s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:55 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 1G Jul 23 22:27:55 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:56 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 1G" returned: 0 in 0.662s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:56 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 Jul 23 22:27:56 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:56 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83" returned: 0 in 0.360s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:56 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 is being set with open permissions: ugo+rw Jul 23 22:27:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:56 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 Jul 23 22:27:56 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:57 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83" returned: 0 in 0.292s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:57 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.info Jul 23 22:27:57 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:57 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.info" returned: 0 in 0.281s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:57 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.info is being set with open permissions: ugo+rw Jul 23 22:27:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:57 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.info Jul 23 22:27:57 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:57 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.info" returned: 0 in 0.262s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Acquiring lock "cinder-quobyte-7648fbab-e273-4218-866c-a6a3e0636cb3" by "_copy_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:27:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Lock "cinder-quobyte-7648fbab-e273-4218-866c-a6a3e0636cb3" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:27:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] snapshot: c3559cea-b67d-442f-b0d4-162c81d6fd83, volume: 7648fbab-e273-4218-866c-a6a3e0636cb3, {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 23 22:27:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:27:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:27:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:27:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:27:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:27:57 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[15825791-14e4-4ef6-97dc-4fc82c26ba22]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:57 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 Jul 23 22:27:57 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:58 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83" returned: 0 in 0.430s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Creating direct copy from snapshot {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6426ba71-ef55-4ac2-9036-f7bcb3e79223]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:58 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf Jul 23 22:27:58 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:58 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf" returned: 0 in 0.457s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG cinder.utils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Path /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7648fbab-e273-4218-866c-a6a3e0636cb3 not found in is_blk_device check {{(pid=88308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7648fbab-e273-4218-866c-a6a3e0636cb3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:27:58 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7648fbab-e273-4218-866c-a6a3e0636cb3 Jul 23 22:27:58 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Flow 'volume_create_manager' (1d5f2bd0-165b-41ef-961b-8dcfebd91dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738f9078-247f-456f-a501-1da14ec93108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738f9078-247f-456f-a501-1da14ec93108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1018013396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2e3e5a-b557-42d2-adc2-e1893ee65ae0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4bdba7d89b7c45ec97b35928842c37f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:59Z,use_quota=True,user_id='d8cc2e1fe09a4334933fb1fac0cac430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86982681-d9e9-4751-9389-0b78a685752a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86982681-d9e9-4751-9389-0b78a685752a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166b90d0-1a5f-4263-8ee8-8d3a03aa9b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166b90d0-1a5f-4263-8ee8-8d3a03aa9b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2e3e5a-b557-42d2-adc2-e1893ee65ae0', 'volume_name': 'volume-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17265c86-6729-4d40-98b1-91c8a60e5414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17265c86-6729-4d40-98b1-91c8a60e5414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e4f419-1a54-48b7-aa89-643e2efd4f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:27:58 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Volume 5a2e3e5a-b557-42d2-adc2-e1893ee65ae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0', 'volume_size': 1} Jul 23 22:27:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:03 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7648fbab-e273-4218-866c-a6a3e0636cb3" returned: 0 in 5.072s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:03 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2491a8-4aaf-4cf6-a429-563ff4b22f20]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:03 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf Jul 23 22:28:03 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:04 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf" returned: 0 in 0.561s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:04 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7648fbab-e273-4218-866c-a6a3e0636cb3 {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:28:04 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Converted 1024.00 MB image at 201.84 MB/s Jul 23 22:28:04 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7648fbab-e273-4218-866c-a6a3e0636cb3 is being set with open permissions: ugo+rw Jul 23 22:28:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7648fbab-e273-4218-866c-a6a3e0636cb3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:04 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7648fbab-e273-4218-866c-a6a3e0636cb3 Jul 23 22:28:04 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:04 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7648fbab-e273-4218-866c-a6a3e0636cb3" returned: 0 in 0.259s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:04 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Lock "cinder-quobyte-7648fbab-e273-4218-866c-a6a3e0636cb3" released by "_copy_volume_from_snapshot" :: held 6.886s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:04 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Acquiring lock "cinder-quobyte-c3559cea-b67d-442f-b0d4-162c81d6fd83" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:04 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Lock "cinder-quobyte-c3559cea-b67d-442f-b0d4-162c81d6fd83" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:04 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Deleting offline snapshot c3559cea-b67d-442f-b0d4-162c81d6fd83 of volume aa3ffca8-c79c-4f8c-a226-6a500b4313cf {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:28:04 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] snapshot_file for this snap is: volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:28:04 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e72251b-f75b-4851-9d4f-0547992500de]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:04 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 Jul 23 22:28:04 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:05 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83" returned: 0 in 0.425s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:05 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:28:05 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5b884e-bc4e-4f4b-94c5-c05b8bd11049]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:05 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf Jul 23 22:28:05 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:05 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf" returned: 0 in 0.455s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:05 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 Jul 23 22:28:05 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:05 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83" returned: 0 in 0.418s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:06 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83 Jul 23 22:28:06 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:06 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf.c3559cea-b67d-442f-b0d4-162c81d6fd83" returned: 0 in 0.277s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Lock "cinder-quobyte-c3559cea-b67d-442f-b0d4-162c81d6fd83" released by "_delete_snapshot" :: held 1.696s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.216s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.701s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b012b413-cf6f-437f-9cce-64ca3041c188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1e89febca94a69bfc9a37b1a8e2d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:55Z,use_quota=True,user_id='4411ddc1b8f04cabb90d76acd1156bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Creating volume b012b413-cf6f-437f-9cce-64ca3041c188 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:28:06 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b012b413-cf6f-437f-9cce-64ca3041c188 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:06 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b012b413-cf6f-437f-9cce-64ca3041c188 1073741824 Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834c6c27-1339-4373-939e-f2464e14f372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7648fbab-e273-4218-866c-a6a3e0636cb3', 'volume_size': 2, 'source_volid': 'aa3ffca8-c79c-4f8c-a226-6a500b4313cf', 'source_volstatus': 'available'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:06 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d013b9-63c2-4227-a924-63e56db572eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:06 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Volume volume-7648fbab-e273-4218-866c-a6a3e0636cb3 (7648fbab-e273-4218-866c-a6a3e0636cb3): created successfully Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d013b9-63c2-4227-a924-63e56db572eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Flow 'volume_create_manager' (88e72fe7-02c6-4831-abaa-7dcc5ee5cb53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:06 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-57923baf-ed7f-4c38-b848-c8204c1b39d9 tempest-VolumesCloneTest-1019767357 None] Created volume successfully. Jul 23 22:28:06 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b012b413-cf6f-437f-9cce-64ca3041c188 1073741824" returned: 0 in 0.471s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b012b413-cf6f-437f-9cce-64ca3041c188 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:06 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b012b413-cf6f-437f-9cce-64ca3041c188 Jul 23 22:28:06 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Acquiring lock "cinder-7648fbab-e273-4218-866c-a6a3e0636cb3-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Lock "cinder-7648fbab-e273-4218-866c-a6a3e0636cb3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:07 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Acquiring lock "cinder-quobyte-7648fbab-e273-4218-866c-a6a3e0636cb3" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b012b413-cf6f-437f-9cce-64ca3041c188" returned: 0 in 0.373s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.424s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1018013396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2e3e5a-b557-42d2-adc2-e1893ee65ae0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4bdba7d89b7c45ec97b35928842c37f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:27:59Z,use_quota=True,user_id='d8cc2e1fe09a4334933fb1fac0cac430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Creating volume 5a2e3e5a-b557-42d2-adc2-e1893ee65ae0 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:28:07 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4911af-39f4-446f-9673-5c94c5e46aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b012b413-cf6f-437f-9cce-64ca3041c188', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:07 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0 1073741824 Jul 23 22:28:07 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445e9732-8eeb-491c-927c-36cab6390c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Lock "cinder-quobyte-7648fbab-e273-4218-866c-a6a3e0636cb3" acquired by "delete_volume" :: waited 0.070s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[65609f8d-d326-4198-b716-53334a08a195]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:07 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Volume volume-b012b413-cf6f-437f-9cce-64ca3041c188 (b012b413-cf6f-437f-9cce-64ca3041c188): created successfully Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445e9732-8eeb-491c-927c-36cab6390c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Flow 'volume_create_manager' (9565d730-fc1e-4454-9be7-7e3b4a51aaaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7648fbab-e273-4218-866c-a6a3e0636cb3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:07 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-191d9e87-f294-4f4a-9a16-706bb78a23b8 tempest-VolumesListAdminTestJSON-908596602 None] Created volume successfully. Jul 23 22:28:07 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7648fbab-e273-4218-866c-a6a3e0636cb3 Jul 23 22:28:07 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Acquiring lock "cinder-b012b413-cf6f-437f-9cce-64ca3041c188-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Lock "cinder-b012b413-cf6f-437f-9cce-64ca3041c188-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Acquiring lock "cinder-quobyte-b012b413-cf6f-437f-9cce-64ca3041c188" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Lock "cinder-quobyte-b012b413-cf6f-437f-9cce-64ca3041c188" acquired by "delete_volume" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[18173fc3-193c-4b62-b693-b6ccad8b3d81]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b012b413-cf6f-437f-9cce-64ca3041c188 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Acquiring lock "cinder-29771903-164f-46e3-a0b0-b0b10e858d01-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:08 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Lock "cinder-29771903-164f-46e3-a0b0-b0b10e858d01-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:08 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:08 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b012b413-cf6f-437f-9cce-64ca3041c188 Jul 23 22:28:08 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7648fbab-e273-4218-866c-a6a3e0636cb3" returned: 0 in 0.690s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7648fbab-e273-4218-866c-a6a3e0636cb3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:08 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7648fbab-e273-4218-866c-a6a3e0636cb3 Jul 23 22:28:08 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:08 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:08 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Acquiring lock "cinder-quobyte-29771903-164f-46e3-a0b0-b0b10e858d01" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0 1073741824" returned: 0 in 0.947s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:08 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Lock "cinder-quobyte-29771903-164f-46e3-a0b0-b0b10e858d01" acquired by "delete_volume" :: waited 0.058s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:08 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2e6b93-8877-4bef-9bb1-f77171582acd]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-29771903-164f-46e3-a0b0-b0b10e858d01 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:08 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0 Jul 23 22:28:08 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:08 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7648fbab-e273-4218-866c-a6a3e0636cb3" returned: 0 in 0.630s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:08 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b012b413-cf6f-437f-9cce-64ca3041c188" returned: 0 in 0.884s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b012b413-cf6f-437f-9cce-64ca3041c188 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:08 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-29771903-164f-46e3-a0b0-b0b10e858d01 Jul 23 22:28:08 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:08 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Lock "cinder-quobyte-7648fbab-e273-4218-866c-a6a3e0636cb3" released by "delete_volume" :: held 1.516s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:08 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b012b413-cf6f-437f-9cce-64ca3041c188 Jul 23 22:28:08 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:08 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Created reservations ['1eacb2a8-cdf0-4dca-97a1-f646ba7af42e', '1bbbfe24-ed31-4390-8475-36913b08859b', 'cb265cea-783c-48dc-92b5-a1b964bcebf7', 'ffd93d5e-9ae9-4d29-ad35-9b53f6d0f80a'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:09 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0" returned: 0 in 0.674s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e4f419-1a54-48b7-aa89-643e2efd4f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71a43cf-4a32-4c87-932b-e18b35866a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:09 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Volume volume-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0 (5a2e3e5a-b557-42d2-adc2-e1893ee65ae0): created successfully Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71a43cf-4a32-4c87-932b-e18b35866a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:09 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Flow 'volume_create_manager' (1d5f2bd0-165b-41ef-961b-8dcfebd91dcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:09 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:09 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:09 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-70217b1a-db55-4045-9d2c-3ceb751ccae3 tempest-VolumesListTestJSON-1441489987 None] Created volume successfully. Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-29771903-164f-46e3-a0b0-b0b10e858d01" returned: 0 in 1.110s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-29771903-164f-46e3-a0b0-b0b10e858d01 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:09 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-29771903-164f-46e3-a0b0-b0b10e858d01 Jul 23 22:28:09 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:09 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b012b413-cf6f-437f-9cce-64ca3041c188" returned: 0 in 0.792s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Lock "cinder-quobyte-b012b413-cf6f-437f-9cce-64ca3041c188" released by "delete_volume" :: held 1.793s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:09 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.542s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:09 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Deleted volume successfully. Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Created reservations ['c131a509-631d-4a80-96f7-8d8c55af1675', 'ef53c1c4-3a8f-4a08-9a5e-2ea80378f046', '3a2ec14f-e6e4-4674-9fb8-e4a7985842db', '21c581d3-8bf8-42ca-9385-d9b6ca9af73a'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e300cd74-8010-4301-abbe-f6094ab564db tempest-VolumesCloneTest-1019767357 None] Lock "cinder-7648fbab-e273-4218-866c-a6a3e0636cb3-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Acquiring lock "cinder-aa3ffca8-c79c-4f8c-a226-6a500b4313cf-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Lock "cinder-aa3ffca8-c79c-4f8c-a226-6a500b4313cf-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Acquiring lock "cinder-quobyte-aa3ffca8-c79c-4f8c-a226-6a500b4313cf" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Lock "cinder-quobyte-aa3ffca8-c79c-4f8c-a226-6a500b4313cf" acquired by "delete_volume" :: waited 0.074s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:10 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:10 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3f47c7-38c0-46da-9fdc-6d2f87de804c]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:10 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-29771903-164f-46e3-a0b0-b0b10e858d01" returned: 0 in 0.892s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Lock "cinder-quobyte-29771903-164f-46e3-a0b0-b0b10e858d01" released by "delete_volume" :: held 2.113s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:10 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf Jul 23 22:28:10 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Created reservations ['cdcc121f-a2dc-42f9-902f-d8bc10b121f7', '039bc2e3-28e3-40e3-b9c4-0935de89c62c', '43860999-06ab-4683-bf6e-b06787dc1c01', 'f1d1cae1-ebc0-42aa-8e44-a30844e9b0b9'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:10 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.465s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:10 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Deleted volume successfully. Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3a51d4da-8498-4f66-ad1b-782abd72b713 tempest-VolumesListAdminTestJSON-908596602 None] Lock "cinder-b012b413-cf6f-437f-9cce-64ca3041c188-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:10 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:10 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Flow 'volume_create_manager' (ef171cf1-c8e5-4d10-ac45-fc337fae30c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c597e7-3869-422a-aef3-b96cc2584184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c597e7-3869-422a-aef3-b96cc2584184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-999139397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b372416e-5f56-4723-86d6-c27ae214eca9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4bdba7d89b7c45ec97b35928842c37f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:28:11Z,use_quota=True,user_id='d8cc2e1fe09a4334933fb1fac0cac430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6086f8f8-20a2-42f8-9c73-edc1e78acfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6086f8f8-20a2-42f8-9c73-edc1e78acfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7862e9-4627-417e-a350-9ec14fc537a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7862e9-4627-417e-a350-9ec14fc537a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b372416e-5f56-4723-86d6-c27ae214eca9', 'volume_name': 'volume-b372416e-5f56-4723-86d6-c27ae214eca9', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ac946a-ac47-495e-a32e-1ef3d22ede96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ac946a-ac47-495e-a32e-1ef3d22ede96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77b9365-6277-4681-9835-ab802351c93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:10 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Volume b372416e-5f56-4723-86d6-c27ae214eca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b372416e-5f56-4723-86d6-c27ae214eca9', 'volume_size': 1} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-999139397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b372416e-5f56-4723-86d6-c27ae214eca9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4bdba7d89b7c45ec97b35928842c37f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:28:11Z,use_quota=True,user_id='d8cc2e1fe09a4334933fb1fac0cac430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Creating volume b372416e-5f56-4723-86d6-c27ae214eca9 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:28:10 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b372416e-5f56-4723-86d6-c27ae214eca9 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:10 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf" returned: 0 in 0.675s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:10 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b372416e-5f56-4723-86d6-c27ae214eca9 1073741824 Jul 23 22:28:10 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:10 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf Jul 23 22:28:10 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:11 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.359s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:11 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Deleted volume successfully. Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-61af4673-9b57-47d4-b152-3ca38f372808 tempest-VolumesListAdminTestJSON-210370417 None] Lock "cinder-29771903-164f-46e3-a0b0-b0b10e858d01-delete_volume" released by "delete_volume" :: held 3.127s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:11 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-aa3ffca8-c79c-4f8c-a226-6a500b4313cf" returned: 0 in 0.302s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Lock "cinder-quobyte-aa3ffca8-c79c-4f8c-a226-6a500b4313cf" released by "delete_volume" :: held 1.087s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Created reservations ['74f6d96b-5f71-4bde-aadf-b40f97454f58', '509f4c86-5750-4378-bd0f-3e3739934782', '3ed77670-15a9-439f-a5c6-e2643910fb95', '29a192d0-6e6c-49c2-aa14-f66f323a9e60'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:11 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:11 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:11 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b372416e-5f56-4723-86d6-c27ae214eca9 1073741824" returned: 0 in 0.619s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Acquiring lock "cinder-107eedc4-bbce-4422-97db-ba1863950eca-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b372416e-5f56-4723-86d6-c27ae214eca9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Lock "cinder-107eedc4-bbce-4422-97db-ba1863950eca-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:11 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b372416e-5f56-4723-86d6-c27ae214eca9 Jul 23 22:28:11 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Acquiring lock "cinder-quobyte-107eedc4-bbce-4422-97db-ba1863950eca" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Lock "cinder-quobyte-107eedc4-bbce-4422-97db-ba1863950eca" acquired by "delete_volume" :: waited 0.043s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:11 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.368s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:11 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Deleted volume successfully. Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ea99cf-837d-4bee-9b87-76f25d60a276]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-107eedc4-bbce-4422-97db-ba1863950eca {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5efb78e2-fb46-495e-a9de-6aa542b62fc3 tempest-VolumesCloneTest-1019767357 None] Lock "cinder-aa3ffca8-c79c-4f8c-a226-6a500b4313cf-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:11 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-107eedc4-bbce-4422-97db-ba1863950eca Jul 23 22:28:11 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:11 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b372416e-5f56-4723-86d6-c27ae214eca9" returned: 0 in 0.335s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77b9365-6277-4681-9835-ab802351c93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b372416e-5f56-4723-86d6-c27ae214eca9', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb5f4ca-90b5-41d0-a424-de7370a67f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:11 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Volume volume-b372416e-5f56-4723-86d6-c27ae214eca9 (b372416e-5f56-4723-86d6-c27ae214eca9): created successfully Jul 23 22:28:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb5f4ca-90b5-41d0-a424-de7370a67f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Flow 'volume_create_manager' (ef171cf1-c8e5-4d10-ac45-fc337fae30c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:12 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-411f1621-d9ba-468d-a8b1-beb2a89c10d6 tempest-VolumesListTestJSON-1441489987 None] Created volume successfully. Jul 23 22:28:12 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-107eedc4-bbce-4422-97db-ba1863950eca" returned: 0 in 0.568s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-107eedc4-bbce-4422-97db-ba1863950eca {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:12 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-107eedc4-bbce-4422-97db-ba1863950eca Jul 23 22:28:12 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:12 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-107eedc4-bbce-4422-97db-ba1863950eca" returned: 0 in 0.308s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Lock "cinder-quobyte-107eedc4-bbce-4422-97db-ba1863950eca" released by "delete_volume" :: held 0.947s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:12 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Created reservations ['4e1fbb60-6fa9-4e3c-a255-8eca8dbc08b3', '47830f06-5e5d-4db5-a8d6-991ac4eb2f22', '112becb9-fccb-4871-bf59-421aa56bbac8', '3b380cbc-26b2-4d78-bca1-4bfe560f698a'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:12 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:12 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:13 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.337s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:13 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Deleted volume successfully. Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-be170f84-e749-4642-b782-f29a2baf94bc tempest-VolumesListAdminTestJSON-210370417 None] Lock "cinder-107eedc4-bbce-4422-97db-ba1863950eca-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Flow 'volume_create_manager' (5bd4e0d5-d2d5-4aac-bfa6-caeac7ef4403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8659016-9df7-48b4-ad62-336c16c1adac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8659016-9df7-48b4-ad62-336c16c1adac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1396532678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437bd1cf-31b3-4866-bc1f-401dbb620bd1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4bdba7d89b7c45ec97b35928842c37f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:28:14Z,use_quota=True,user_id='d8cc2e1fe09a4334933fb1fac0cac430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58824f3-0a1e-4339-a5a2-830e291f6532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58824f3-0a1e-4339-a5a2-830e291f6532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a66a4f-26f3-4245-af54-b87241ce45c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a66a4f-26f3-4245-af54-b87241ce45c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '437bd1cf-31b3-4866-bc1f-401dbb620bd1', 'volume_name': 'volume-437bd1cf-31b3-4866-bc1f-401dbb620bd1', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a208f325-6364-44e6-a59c-6e4902fe4deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a208f325-6364-44e6-a59c-6e4902fe4deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73d23aad-571e-4631-bfb8-0c7f7ae496e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:13 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Volume 437bd1cf-31b3-4866-bc1f-401dbb620bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-437bd1cf-31b3-4866-bc1f-401dbb620bd1', 'volume_size': 1} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1396532678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437bd1cf-31b3-4866-bc1f-401dbb620bd1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4bdba7d89b7c45ec97b35928842c37f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:28:14Z,use_quota=True,user_id='d8cc2e1fe09a4334933fb1fac0cac430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Creating volume 437bd1cf-31b3-4866-bc1f-401dbb620bd1 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:28:13 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:28:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-437bd1cf-31b3-4866-bc1f-401dbb620bd1 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:13 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-437bd1cf-31b3-4866-bc1f-401dbb620bd1 1073741824 Jul 23 22:28:13 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Acquiring lock "cinder-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Lock "cinder-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Acquiring lock "cinder-quobyte-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Lock "cinder-quobyte-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5" acquired by "delete_volume" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:14 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb61f60a-8fb0-45d3-b53f-72ee96ed3efc]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:14 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5 Jul 23 22:28:14 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:14 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-437bd1cf-31b3-4866-bc1f-401dbb620bd1 1073741824" returned: 0 in 0.995s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:14 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5" returned: 0 in 0.638s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:15 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5 Jul 23 22:28:15 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-437bd1cf-31b3-4866-bc1f-401dbb620bd1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:15 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-437bd1cf-31b3-4866-bc1f-401dbb620bd1 Jul 23 22:28:15 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:15 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-437bd1cf-31b3-4866-bc1f-401dbb620bd1" returned: 0 in 0.411s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73d23aad-571e-4631-bfb8-0c7f7ae496e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437bd1cf-31b3-4866-bc1f-401dbb620bd1', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91dfc49f-c8e3-4317-9f39-953db6f7b6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:15 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5" returned: 0 in 0.561s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:15 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Volume volume-437bd1cf-31b3-4866-bc1f-401dbb620bd1 (437bd1cf-31b3-4866-bc1f-401dbb620bd1): created successfully Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91dfc49f-c8e3-4317-9f39-953db6f7b6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Flow 'volume_create_manager' (5bd4e0d5-d2d5-4aac-bfa6-caeac7ef4403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Lock "cinder-quobyte-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5" released by "delete_volume" :: held 1.343s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:15 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6b4b55f2-5afd-4493-b533-9dc48ea6e068 tempest-VolumesListTestJSON-1441489987 None] Created volume successfully. Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Created reservations ['96ae2e5c-4182-48f4-95c4-9125da145ea3', 'e3a67025-c8bd-401c-b2d2-b0e47e960285', '7cdd5083-28c1-47b7-9e1c-060774be02e2', 'ddb01174-556a-4578-8d3f-417da65b906a'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:15 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:15 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:16 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.447s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:16 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:16 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Deleted volume successfully. Jul 23 22:28:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6996e5cb-d71a-43cb-846e-e453dc09ec03 tempest-VolumesListAdminTestJSON-210370417 None] Lock "cinder-fc1880e1-bbfb-446d-95e2-d63e8e2f60b5-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Flow 'volume_create_manager' (f342753b-085e-4448-a81f-1312a950893c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a402b4f9-6c89-4ad7-8359-2d1cf39e8fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a402b4f9-6c89-4ad7-8359-2d1cf39e8fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-938228197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3de1b9c-1c00-4caa-838d-bf4f8f9a7227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e81bedbb48c48b08108b0aa632c47bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:28:17Z,use_quota=True,user_id='44f6876bcfef41cea4ed38f609cadff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd4ca38-9c40-48dc-8123-25c6609157f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd4ca38-9c40-48dc-8123-25c6609157f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3252482d-9f16-4e91-8357-4d9fb04065a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3252482d-9f16-4e91-8357-4d9fb04065a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3de1b9c-1c00-4caa-838d-bf4f8f9a7227', 'volume_name': 'volume-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853e339c-061f-460e-be7a-84ffa8649210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853e339c-061f-460e-be7a-84ffa8649210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c957c1e-8f01-4873-8ee5-3eb0e63e838b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:17 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Volume e3de1b9c-1c00-4caa-838d-bf4f8f9a7227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227', 'volume_size': 1} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-938228197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3de1b9c-1c00-4caa-838d-bf4f8f9a7227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e81bedbb48c48b08108b0aa632c47bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:28:17Z,use_quota=True,user_id='44f6876bcfef41cea4ed38f609cadff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Creating volume e3de1b9c-1c00-4caa-838d-bf4f8f9a7227 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:28:17 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:17 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227 1073741824 Jul 23 22:28:17 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:17 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227 1073741824" returned: 0 in 0.625s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:17 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227 Jul 23 22:28:17 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:18 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227" returned: 0 in 0.480s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:28:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c957c1e-8f01-4873-8ee5-3eb0e63e838b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f980f8-62db-4646-932a-a73838fdef3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:18 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Volume volume-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227 (e3de1b9c-1c00-4caa-838d-bf4f8f9a7227): created successfully Jul 23 22:28:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f980f8-62db-4646-932a-a73838fdef3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Flow 'volume_create_manager' (f342753b-085e-4448-a81f-1312a950893c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:18 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-64c88122-4ce6-4de3-8e14-1cfc5d59e9a0 tempest-VolumesNegativeTest-1682544986 None] Created volume successfully. Jul 23 22:28:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Acquiring lock "cinder-437bd1cf-31b3-4866-bc1f-401dbb620bd1-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Lock "cinder-437bd1cf-31b3-4866-bc1f-401dbb620bd1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Acquiring lock "cinder-quobyte-437bd1cf-31b3-4866-bc1f-401dbb620bd1" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Lock "cinder-quobyte-437bd1cf-31b3-4866-bc1f-401dbb620bd1" acquired by "delete_volume" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:19 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e32887c-1872-4e3a-aef4-3f53d508f920]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-437bd1cf-31b3-4866-bc1f-401dbb620bd1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:20 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-437bd1cf-31b3-4866-bc1f-401dbb620bd1 Jul 23 22:28:20 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:20 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-437bd1cf-31b3-4866-bc1f-401dbb620bd1" returned: 0 in 0.562s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-437bd1cf-31b3-4866-bc1f-401dbb620bd1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:20 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-437bd1cf-31b3-4866-bc1f-401dbb620bd1 Jul 23 22:28:20 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:20 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-437bd1cf-31b3-4866-bc1f-401dbb620bd1" returned: 0 in 0.379s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:20 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Lock "cinder-quobyte-437bd1cf-31b3-4866-bc1f-401dbb620bd1" released by "delete_volume" :: held 1.024s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:20 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Created reservations ['20515046-3a54-439d-9794-6de2920eaa62', '444f90d8-afb8-4e82-a42f-a476ef5e8717', 'ed09e6ad-3d00-45bf-a66c-fd474703dbdc', 'c13fbc3f-9ad8-4d8f-afcd-7a041ca2e71f'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:21 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:21 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:21 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.450s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:21 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:21 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Deleted volume successfully. Jul 23 22:28:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ec8bb8be-7856-4c8a-b631-44a58df5d6c9 tempest-VolumesListTestJSON-1441489987 None] Lock "cinder-437bd1cf-31b3-4866-bc1f-401dbb620bd1-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Acquiring lock "cinder-b372416e-5f56-4723-86d6-c27ae214eca9-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Lock "cinder-b372416e-5f56-4723-86d6-c27ae214eca9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Acquiring lock "cinder-quobyte-b372416e-5f56-4723-86d6-c27ae214eca9" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Lock "cinder-quobyte-b372416e-5f56-4723-86d6-c27ae214eca9" acquired by "delete_volume" :: waited 0.039s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:22 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcdb035-77a2-423b-b970-085291637cfe]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b372416e-5f56-4723-86d6-c27ae214eca9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:22 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b372416e-5f56-4723-86d6-c27ae214eca9 Jul 23 22:28:22 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:23 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b372416e-5f56-4723-86d6-c27ae214eca9" returned: 0 in 0.664s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b372416e-5f56-4723-86d6-c27ae214eca9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:23 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b372416e-5f56-4723-86d6-c27ae214eca9 Jul 23 22:28:23 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:23 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b372416e-5f56-4723-86d6-c27ae214eca9" returned: 0 in 0.484s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Lock "cinder-quobyte-b372416e-5f56-4723-86d6-c27ae214eca9" released by "delete_volume" :: held 1.213s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:23 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Created reservations ['b3e4adb3-5402-4690-bf1d-24b0a6b322e3', 'b4dcf9a2-6e75-4f92-8155-16bd30bc41bc', '5c987f94-9696-4714-ad92-350e4b8d030f', 'd683a1f6-17e3-4d60-b132-e0e2e1d6c6f8'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:23 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:23 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:24 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.518s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:24 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:24 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Deleted volume successfully. Jul 23 22:28:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-fc915922-e7b0-44d2-8e7e-45b97036bdd7 tempest-VolumesListTestJSON-1441489987 None] Lock "cinder-b372416e-5f56-4723-86d6-c27ae214eca9-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Acquiring lock "cinder-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Lock "cinder-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Acquiring lock "cinder-quobyte-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Lock "cinder-quobyte-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0" acquired by "delete_volume" :: waited 0.033s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:25 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[210486d5-caa1-4b72-89fa-e070bb4f8a2d]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:25 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0 Jul 23 22:28:25 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:25 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0" returned: 0 in 0.435s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:25 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0 Jul 23 22:28:25 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:25 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0" returned: 0 in 0.317s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Lock "cinder-quobyte-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0" released by "delete_volume" :: held 0.816s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:25 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Created reservations ['4ba80256-c481-49df-b5a8-b9fa822e53d5', '5eb6d400-01a7-4923-9916-ed78f088ea92', '9aeca600-871f-432a-a592-f7ffd7824970', '9ab2996b-8429-41e3-b72b-8c105f526896'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:26 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:26 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:28:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:26 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:26 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:26 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.332s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:26 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.446s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:28:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 28 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:28:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:28:26 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Deleted volume successfully. Jul 23 22:28:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-20268ba8-5522-41b6-ad61-a4c567ab9172 tempest-VolumesListTestJSON-1441489987 None] Lock "cinder-5a2e3e5a-b557-42d2-adc2-e1893ee65ae0-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Flow 'volume_create_manager' (336af3f6-f644-4819-83e8-2644c9c44914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb89b458-7b8f-4d54-a15e-4cf6a5221b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb89b458-7b8f-4d54-a15e-4cf6a5221b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1279753131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c16bf0-9bac-4309-bccf-6bfd14c674e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03aa010e4024bdea55d614b9a535b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:28:31Z,use_quota=True,user_id='134b16dc7a07411db2c4cfa2a21be42f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7ea7aa-dd78-426d-bac9-c8022d695182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7ea7aa-dd78-426d-bac9-c8022d695182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3afa92-0b51-4ebe-8541-bee10b86017f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3afa92-0b51-4ebe-8541-bee10b86017f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c16bf0-9bac-4309-bccf-6bfd14c674e1', 'volume_name': 'volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55eccb39-2c57-4867-97cd-20143af5fa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55eccb39-2c57-4867-97cd-20143af5fa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f27d38-9bcc-41f4-9288-cbb56a296fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:30 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Volume c4c16bf0-9bac-4309-bccf-6bfd14c674e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1', 'volume_size': 1} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1279753131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c16bf0-9bac-4309-bccf-6bfd14c674e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03aa010e4024bdea55d614b9a535b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:28:31Z,use_quota=True,user_id='134b16dc7a07411db2c4cfa2a21be42f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Creating volume c4c16bf0-9bac-4309-bccf-6bfd14c674e1 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:28:30 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:28:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:31 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 1073741824 Jul 23 22:28:31 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:31 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 1073741824" returned: 0 in 0.602s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:31 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 Jul 23 22:28:31 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:32 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" returned: 0 in 0.479s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f27d38-9bcc-41f4-9288-cbb56a296fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d45312c-2557-435e-9750-71b06d857248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:32 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Volume volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 (c4c16bf0-9bac-4309-bccf-6bfd14c674e1): created successfully Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d45312c-2557-435e-9750-71b06d857248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Flow 'volume_create_manager' (336af3f6-f644-4819-83e8-2644c9c44914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:32 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-cc2ae8b4-0bdd-49fc-8961-2ed0078802bb tempest-VolumesSnapshotListTestJSON-1899623150 None] Created volume successfully. Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Flow 'volume_create_manager' (0da79463-6ba5-4d50-9b69-00fddef39ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a094b6-d13d-43ea-abf9-7351d63d144f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a094b6-d13d-43ea-abf9-7351d63d144f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-372709950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e71af88-c912-4874-8171-64e4979dbdf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b8524984c04e49aefd900f1d6b8052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:28:32Z,use_quota=True,user_id='3a0ac3b97d064d40885e9b54b071018d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67240dca-f54f-430e-a8e6-6a843beff22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67240dca-f54f-430e-a8e6-6a843beff22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d7d1aa-1e5d-47a7-a78a-6717862cf38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d7d1aa-1e5d-47a7-a78a-6717862cf38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e71af88-c912-4874-8171-64e4979dbdf6', 'volume_name': 'volume-3e71af88-c912-4874-8171-64e4979dbdf6', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c308c63d-51ae-4471-aeb1-2f77ec1bbc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c308c63d-51ae-4471-aeb1-2f77ec1bbc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a53879-d445-488e-9806-9e0da175665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:32 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Volume 3e71af88-c912-4874-8171-64e4979dbdf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e71af88-c912-4874-8171-64e4979dbdf6', 'volume_size': 1} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-372709950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e71af88-c912-4874-8171-64e4979dbdf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b8524984c04e49aefd900f1d6b8052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:28:32Z,use_quota=True,user_id='3a0ac3b97d064d40885e9b54b071018d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Creating volume 3e71af88-c912-4874-8171-64e4979dbdf6 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:28:32 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:28:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3e71af88-c912-4874-8171-64e4979dbdf6 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:32 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3e71af88-c912-4874-8171-64e4979dbdf6 1073741824 Jul 23 22:28:32 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:33 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3e71af88-c912-4874-8171-64e4979dbdf6 1073741824" returned: 0 in 0.777s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3e71af88-c912-4874-8171-64e4979dbdf6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:33 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3e71af88-c912-4874-8171-64e4979dbdf6 Jul 23 22:28:33 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:33 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3e71af88-c912-4874-8171-64e4979dbdf6" returned: 0 in 0.294s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:28:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.277s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] Creating offline snapshot f616cc11-2c98-486d-9ee1-45a9dfed9dbe of volume c4c16bf0-9bac-4309-bccf-6bfd14c674e1 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:28:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a53879-d445-488e-9806-9e0da175665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e71af88-c912-4874-8171-64e4979dbdf6', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16469af2-a062-493f-906f-0412cbc301e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:33 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf482f3b-ecf3-4d20-8580-672515072fad]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:33 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Volume volume-3e71af88-c912-4874-8171-64e4979dbdf6 (3e71af88-c912-4874-8171-64e4979dbdf6): created successfully Jul 23 22:28:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16469af2-a062-493f-906f-0412cbc301e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Flow 'volume_create_manager' (0da79463-6ba5-4d50-9b69-00fddef39ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:33 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-9c5c6016-e165-4163-8eb0-20fcd6353b4c tempest-AbsoluteLimitsTests-533178130 None] Created volume successfully. Jul 23 22:28:33 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 Jul 23 22:28:33 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:34 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" returned: 0 in 0.435s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:34 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe 1G Jul 23 22:28:34 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:34 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe 1G" returned: 0 in 0.550s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:34 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Acquiring lock "cinder-3e71af88-c912-4874-8171-64e4979dbdf6-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:34 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe Jul 23 22:28:34 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:34 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Lock "cinder-3e71af88-c912-4874-8171-64e4979dbdf6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:34 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Acquiring lock "cinder-quobyte-3e71af88-c912-4874-8171-64e4979dbdf6" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:34 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Lock "cinder-quobyte-3e71af88-c912-4874-8171-64e4979dbdf6" acquired by "delete_volume" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:34 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb0b277-8853-483a-a170-28bc6ec979f4]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3e71af88-c912-4874-8171-64e4979dbdf6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:34 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3e71af88-c912-4874-8171-64e4979dbdf6 Jul 23 22:28:34 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:35 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe" returned: 0 in 0.338s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:35 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe is being set with open permissions: ugo+rw Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:35 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe Jul 23 22:28:35 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:35 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3e71af88-c912-4874-8171-64e4979dbdf6" returned: 0 in 0.408s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3e71af88-c912-4874-8171-64e4979dbdf6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:35 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3e71af88-c912-4874-8171-64e4979dbdf6 Jul 23 22:28:35 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:35 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe" returned: 0 in 0.265s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:35 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.info Jul 23 22:28:35 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:35 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3e71af88-c912-4874-8171-64e4979dbdf6" returned: 0 in 0.325s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Lock "cinder-quobyte-3e71af88-c912-4874-8171-64e4979dbdf6" released by "delete_volume" :: held 0.790s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:35 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.info" returned: 0 in 0.312s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:35 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.info is being set with open permissions: ugo+rw Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Created reservations ['39c13fc5-1508-4396-aef8-268a7749530b', '4ad5476c-e631-4e87-92c7-7ce47426ddaa', '63f48857-d560-4dfc-abaa-cc1ec8831860', 'e87cb4a3-7f9d-4ad8-b1f0-76ba85c045a4'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:35 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.info Jul 23 22:28:35 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:35 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:35 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:36 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.info" returned: 0 in 0.489s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:36 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-3a5c404b-672e-4ad8-b7de-0ec983a8b178 tempest-VolumesSnapshotListTestJSON-1899623150 None] Create snapshot completed successfully Jul 23 22:28:36 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.526s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:36 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Deleted volume successfully. Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6b182d5b-95fd-4915-aa0e-0c4fee76a219 tempest-AbsoluteLimitsTests-533178130 None] Lock "cinder-3e71af88-c912-4874-8171-64e4979dbdf6-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Flow 'volume_create_manager' (ec931d14-924c-4bd8-b53c-13005ae0f5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca31a25-ce7e-4de7-a05c-6a58e0446d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca31a25-ce7e-4de7-a05c-6a58e0446d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1729152718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022ce29a-b0f7-4a83-aea2-22d108ee511a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66965df715f468cabd95bed46d8b01e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:28:36Z,use_quota=True,user_id='50d81bff5eeb43728af8641f16b77916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed797232-e07d-4b6d-aeb3-aaa513108036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed797232-e07d-4b6d-aeb3-aaa513108036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09eca56-0ffe-40f1-938a-dc619725dae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09eca56-0ffe-40f1-938a-dc619725dae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '022ce29a-b0f7-4a83-aea2-22d108ee511a', 'volume_name': 'volume-022ce29a-b0f7-4a83-aea2-22d108ee511a', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1d86db-847b-499a-b4a5-0b83e9636bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1d86db-847b-499a-b4a5-0b83e9636bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339d293f-2f7b-4419-839d-22cf5d21a596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:36 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Volume 022ce29a-b0f7-4a83-aea2-22d108ee511a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-022ce29a-b0f7-4a83-aea2-22d108ee511a', 'volume_size': 1} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1729152718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022ce29a-b0f7-4a83-aea2-22d108ee511a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a66965df715f468cabd95bed46d8b01e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:28:36Z,use_quota=True,user_id='50d81bff5eeb43728af8641f16b77916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Creating volume 022ce29a-b0f7-4a83-aea2-22d108ee511a {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:28:36 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-022ce29a-b0f7-4a83-aea2-22d108ee511a 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:36 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-022ce29a-b0f7-4a83-aea2-22d108ee511a 1073741824 Jul 23 22:28:36 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6e2a76ba-887d-4009-82b9-d68832f85c8a tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:37 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-022ce29a-b0f7-4a83-aea2-22d108ee511a 1073741824" returned: 0 in 0.570s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-022ce29a-b0f7-4a83-aea2-22d108ee511a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:37 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-022ce29a-b0f7-4a83-aea2-22d108ee511a Jul 23 22:28:37 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:37 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-022ce29a-b0f7-4a83-aea2-22d108ee511a" returned: 0 in 0.265s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:28:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6e2a76ba-887d-4009-82b9-d68832f85c8a tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.636s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339d293f-2f7b-4419-839d-22cf5d21a596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-022ce29a-b0f7-4a83-aea2-22d108ee511a', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1574d80-1a0b-466d-aebf-c77cf2aba284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6e2a76ba-887d-4009-82b9-d68832f85c8a tempest-VolumesSnapshotListTestJSON-1899623150 None] Creating offline snapshot 7009590a-1817-4917-97fb-69ad427f5422 of volume c4c16bf0-9bac-4309-bccf-6bfd14c674e1 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:28:37 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Volume volume-022ce29a-b0f7-4a83-aea2-22d108ee511a (022ce29a-b0f7-4a83-aea2-22d108ee511a): created successfully Jul 23 22:28:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1574d80-1a0b-466d-aebf-c77cf2aba284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Flow 'volume_create_manager' (ec931d14-924c-4bd8-b53c-13005ae0f5de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:37 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7840aa92-62db-4242-984a-17d50fa50461]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6e2a76ba-887d-4009-82b9-d68832f85c8a tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:37 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-12be4c7b-b277-4dd8-a711-282bfebc7025 tempest-AttachVolumeNegativeTest-577220995 None] Created volume successfully. Jul 23 22:28:37 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe Jul 23 22:28:37 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:37 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6e2a76ba-887d-4009-82b9-d68832f85c8a tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe" returned: 0 in 0.443s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6e2a76ba-887d-4009-82b9-d68832f85c8a tempest-VolumesSnapshotListTestJSON-1899623150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:28:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6e2a76ba-887d-4009-82b9-d68832f85c8a tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:37 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 1G Jul 23 22:28:37 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:38 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6e2a76ba-887d-4009-82b9-d68832f85c8a tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 1G" returned: 0 in 0.639s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6e2a76ba-887d-4009-82b9-d68832f85c8a tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:38 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 Jul 23 22:28:38 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:38 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6e2a76ba-887d-4009-82b9-d68832f85c8a tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422" returned: 0 in 0.378s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:38 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-6e2a76ba-887d-4009-82b9-d68832f85c8a tempest-VolumesSnapshotListTestJSON-1899623150 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 is being set with open permissions: ugo+rw Jul 23 22:28:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6e2a76ba-887d-4009-82b9-d68832f85c8a tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:39 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 Jul 23 22:28:39 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:39 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6e2a76ba-887d-4009-82b9-d68832f85c8a tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422" returned: 0 in 0.395s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6e2a76ba-887d-4009-82b9-d68832f85c8a tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.025s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:39 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6e2a76ba-887d-4009-82b9-d68832f85c8a tempest-VolumesSnapshotListTestJSON-1899623150 None] Create snapshot completed successfully Jul 23 22:28:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-9bd3dc98-a1f8-4527-afa5-286df4e7eebd req-38c9596e-51ec-445c-9a36-287ff00b754e tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-9bd3dc98-a1f8-4527-afa5-286df4e7eebd req-38c9596e-51ec-445c-9a36-287ff00b754e tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:39 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b90c786-a04f-49c8-9590-89c9bf81df7e]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-9bd3dc98-a1f8-4527-afa5-286df4e7eebd req-38c9596e-51ec-445c-9a36-287ff00b754e tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-022ce29a-b0f7-4a83-aea2-22d108ee511a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:39 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-022ce29a-b0f7-4a83-aea2-22d108ee511a Jul 23 22:28:39 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:40 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-059b4c9c-9ac0-4fba-b36f-4bff6071468d tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-9bd3dc98-a1f8-4527-afa5-286df4e7eebd req-38c9596e-51ec-445c-9a36-287ff00b754e tempest-AttachVolumeNegativeTest-577220995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-022ce29a-b0f7-4a83-aea2-22d108ee511a" returned: 0 in 0.484s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-9bd3dc98-a1f8-4527-afa5-286df4e7eebd req-38c9596e-51ec-445c-9a36-287ff00b754e tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.506s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-059b4c9c-9ac0-4fba-b36f-4bff6071468d tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-059b4c9c-9ac0-4fba-b36f-4bff6071468d tempest-VolumesSnapshotListTestJSON-1899623150 None] Creating offline snapshot cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 of volume c4c16bf0-9bac-4309-bccf-6bfd14c674e1 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:28:40 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[207c9829-2cb3-4819-9bba-f0e85906d1fa]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-059b4c9c-9ac0-4fba-b36f-4bff6071468d tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-9bd3dc98-a1f8-4527-afa5-286df4e7eebd req-38c9596e-51ec-445c-9a36-287ff00b754e tempest-AttachVolumeNegativeTest-577220995 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-022ce29a-b0f7-4a83-aea2-22d108ee511a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c4e3d0e-e5b9-48c3-9bb4-a81153c90bba', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:28:40 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-9bd3dc98-a1f8-4527-afa5-286df4e7eebd req-38c9596e-51ec-445c-9a36-287ff00b754e tempest-AttachVolumeNegativeTest-577220995 None] attachment_update completed successfully. Jul 23 22:28:40 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 Jul 23 22:28:40 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:40 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-059b4c9c-9ac0-4fba-b36f-4bff6071468d tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422" returned: 0 in 0.573s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-059b4c9c-9ac0-4fba-b36f-4bff6071468d tempest-VolumesSnapshotListTestJSON-1899623150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:28:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-059b4c9c-9ac0-4fba-b36f-4bff6071468d tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:40 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 1G Jul 23 22:28:40 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:41 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:28:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Flow 'volume_create_manager' (2a6423b6-e767-43b2-af39-7f0dea0b138d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d0ae4b-386c-4988-8eb5-fcc3d175b659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d0ae4b-386c-4988-8eb5-fcc3d175b659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2111480700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=603d941a-80fb-4a40-b508-51a447e49dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6773fb63e045a497ba490ce7c899a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:28:41Z,use_quota=True,user_id='bd5c7f9d3d2f41fb9619ec77db49f732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995169b1-2e97-4980-a186-8c5a35e0628e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995169b1-2e97-4980-a186-8c5a35e0628e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813991e7-591d-4371-b0fb-dc775843b776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813991e7-591d-4371-b0fb-dc775843b776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '603d941a-80fb-4a40-b508-51a447e49dc2', 'volume_name': 'volume-603d941a-80fb-4a40-b508-51a447e49dc2', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f4a080-c760-426b-93a8-02d1e64400fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f4a080-c760-426b-93a8-02d1e64400fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0235edc0-a162-4857-81ed-96d78f3217f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:41 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Volume 603d941a-80fb-4a40-b508-51a447e49dc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-603d941a-80fb-4a40-b508-51a447e49dc2', 'volume_size': 1} Jul 23 22:28:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:41 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-059b4c9c-9ac0-4fba-b36f-4bff6071468d tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 1G" returned: 0 in 0.655s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-059b4c9c-9ac0-4fba-b36f-4bff6071468d tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:41 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 Jul 23 22:28:41 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:41 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-059b4c9c-9ac0-4fba-b36f-4bff6071468d tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07" returned: 0 in 0.371s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:41 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-059b4c9c-9ac0-4fba-b36f-4bff6071468d tempest-VolumesSnapshotListTestJSON-1899623150 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 is being set with open permissions: ugo+rw Jul 23 22:28:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-059b4c9c-9ac0-4fba-b36f-4bff6071468d tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:41 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 Jul 23 22:28:41 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:42 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-059b4c9c-9ac0-4fba-b36f-4bff6071468d tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07" returned: 0 in 0.351s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-059b4c9c-9ac0-4fba-b36f-4bff6071468d tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.077s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.157s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2111480700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=603d941a-80fb-4a40-b508-51a447e49dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6773fb63e045a497ba490ce7c899a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:28:41Z,use_quota=True,user_id='bd5c7f9d3d2f41fb9619ec77db49f732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Creating volume 603d941a-80fb-4a40-b508-51a447e49dc2 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:28:42 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:42 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 1073741824 Jul 23 22:28:42 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:42 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-059b4c9c-9ac0-4fba-b36f-4bff6071468d tempest-VolumesSnapshotListTestJSON-1899623150 None] Create snapshot completed successfully Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Acquiring lock "cinder-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Lock "cinder-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Acquiring lock "cinder-quobyte-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Lock "cinder-quobyte-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227" acquired by "delete_volume" :: waited 0.025s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3a05e3-1ab8-4dc5-9018-398fd4dc306a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:42 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-636b2eed-75bf-4ecd-98ae-7e5392e88ccd req-13bb47a7-9c8d-41ad-bb7b-35a7b26f90f5 tempest-AttachVolumeNegativeTest-577220995 None] Terminate volume connection completed successfully. Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-636b2eed-75bf-4ecd-98ae-7e5392e88ccd req-13bb47a7-9c8d-41ad-bb7b-35a7b26f90f5 tempest-AttachVolumeNegativeTest-577220995 None] Deleting attachment 3c4e3d0e-e5b9-48c3-9bb4-a81153c90bba. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:28:42 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227 Jul 23 22:28:42 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:42 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 1073741824" returned: 0 in 0.566s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:42 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 Jul 23 22:28:42 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:43 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227" returned: 0 in 0.423s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:43 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227 Jul 23 22:28:43 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:43 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2" returned: 0 in 0.258s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0235edc0-a162-4857-81ed-96d78f3217f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-603d941a-80fb-4a40-b508-51a447e49dc2', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b96688-334b-4d3d-9cd1-58e24709f8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:43 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Volume volume-603d941a-80fb-4a40-b508-51a447e49dc2 (603d941a-80fb-4a40-b508-51a447e49dc2): created successfully Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b96688-334b-4d3d-9cd1-58e24709f8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Flow 'volume_create_manager' (2a6423b6-e767-43b2-af39-7f0dea0b138d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:43 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f9d3977e-a3d7-49db-ab09-5fa473868db2 tempest-VolumesDeleteCascade-1580014360 None] Created volume successfully. Jul 23 22:28:43 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227" returned: 0 in 0.272s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Lock "cinder-quobyte-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227" released by "delete_volume" :: held 0.754s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Created reservations ['c9f36268-b2ae-4883-a5e0-a8b6522818bb', '60b01893-5764-43ee-82b6-ffe6f4c0c977', 'aa91dac9-54f0-4f19-9382-86ef636d36f6', 'dd4de7e9-2734-46b8-8ce4-22ff5d287945'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:43 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:43 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:43 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.328s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:43 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Deleted volume successfully. Jul 23 22:28:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47860811-ed55-4058-ab30-b83dc3b9bb58 tempest-VolumesNegativeTest-1682544986 None] Lock "cinder-e3de1b9c-1c00-4caa-838d-bf4f8f9a7227-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "cinder-cda2251d-61c1-4f1c-a5b6-3d960ef9bc07-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-cda2251d-61c1-4f1c-a5b6-3d960ef9bc07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "cinder-quobyte-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-quobyte-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "cinder-quobyte-cda2251d-61c1-4f1c-a5b6-3d960ef9bc07" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-quobyte-cda2251d-61c1-4f1c-a5b6-3d960ef9bc07" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Deleting offline snapshot cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 of volume c4c16bf0-9bac-4309-bccf-6bfd14c674e1 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:28:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] snapshot_file for this snap is: volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:28:44 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe057bf4-3d1b-4882-82aa-bdd70502d758]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] Creating offline snapshot 0d7effcd-4f86-4603-89c7-f5732fe466ce of volume 603d941a-80fb-4a40-b508-51a447e49dc2 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:28:44 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fc9bef-8fe3-4069-bc0a-ccf37ab643cc]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:44 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 Jul 23 22:28:44 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:44 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 Jul 23 22:28:44 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:45 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2" returned: 0 in 0.436s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:45 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce 1G Jul 23 22:28:45 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:45 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07" returned: 0 in 0.585s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:28:45 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[45833fff-4730-43c4-86e2-b860caa129f2]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:45 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 Jul 23 22:28:45 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:45 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce 1G" returned: 0 in 0.630s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-603d941a-80fb-4a40-b508-51a447e49dc2 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:45 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-603d941a-80fb-4a40-b508-51a447e49dc2 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce Jul 23 22:28:45 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:45 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422" returned: 0 in 0.558s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:28:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:46 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 Jul 23 22:28:46 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:46 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-603d941a-80fb-4a40-b508-51a447e49dc2 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce" returned: 0 in 0.422s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:46 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce is being set with open permissions: ugo+rw Jul 23 22:28:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:46 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce Jul 23 22:28:46 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:46 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07" returned: 0 in 0.593s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:46 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07 Jul 23 22:28:46 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:46 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce" returned: 0 in 0.304s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:46 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.info Jul 23 22:28:46 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:46 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.cda2251d-61c1-4f1c-a5b6-3d960ef9bc07" returned: 0 in 0.365s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-quobyte-cda2251d-61c1-4f1c-a5b6-3d960ef9bc07" released by "_delete_snapshot" :: held 2.263s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-quobyte-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" released by "delete_snapshot" :: held 2.297s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:47 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.info" returned: 0 in 0.326s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:47 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.info is being set with open permissions: ugo+rw Jul 23 22:28:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:47 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.info Jul 23 22:28:47 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:47 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Created reservations ['5e3d6de5-042e-4f1d-b0ca-21aaa5973e4c', '24cc5325-ed7f-4911-b61a-b2a337eb3716', 'eb790858-9f20-4a3e-99b4-69e726afc997', '60b4e8d9-f468-4c95-a70b-f3ad4d883103'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:47 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Delete snapshot completed successfully. Jul 23 22:28:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9d97ffe6-2217-49b8-8d1b-970beb370736 tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-cda2251d-61c1-4f1c-a5b6-3d960ef9bc07-delete_snapshot" released by "delete_snapshot" :: held 2.535s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:47 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.info" returned: 0 in 0.306s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.567s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:47 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-57ffabba-3d53-4df1-addb-9abbca8e6e8a tempest-VolumesDeleteCascade-1580014360 None] Create snapshot completed successfully Jul 23 22:28:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "cinder-022ce29a-b0f7-4a83-aea2-22d108ee511a-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "cinder-7009590a-1817-4917-97fb-69ad427f5422-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Lock "cinder-022ce29a-b0f7-4a83-aea2-22d108ee511a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-7009590a-1817-4917-97fb-69ad427f5422-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "cinder-quobyte-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-quobyte-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "cinder-quobyte-7009590a-1817-4917-97fb-69ad427f5422" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "cinder-quobyte-022ce29a-b0f7-4a83-aea2-22d108ee511a" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-quobyte-7009590a-1817-4917-97fb-69ad427f5422" acquired by "_delete_snapshot" :: waited 0.091s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Deleting offline snapshot 7009590a-1817-4917-97fb-69ad427f5422 of volume c4c16bf0-9bac-4309-bccf-6bfd14c674e1 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] snapshot_file for this snap is: volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Lock "cinder-quobyte-022ce29a-b0f7-4a83-aea2-22d108ee511a" acquired by "delete_volume" :: waited 0.084s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cc57aa-9b94-4f61-8943-238fd6dbcd1d]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5def9629-1348-4a29-9315-16d219111748]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-022ce29a-b0f7-4a83-aea2-22d108ee511a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-559da8ce-a407-4235-a104-a01776654e6f tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-559da8ce-a407-4235-a104-a01776654e6f tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-559da8ce-a407-4235-a104-a01776654e6f tempest-VolumesDeleteCascade-1580014360 None] Creating offline snapshot e0e10ab4-0db7-4405-be9a-dd19ecf14fef of volume 603d941a-80fb-4a40-b508-51a447e49dc2 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:28:48 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 Jul 23 22:28:48 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:48 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-022ce29a-b0f7-4a83-aea2-22d108ee511a Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c659d0-5036-48cc-85c5-913aaba00497]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-559da8ce-a407-4235-a104-a01776654e6f tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:48 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:48 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce Jul 23 22:28:48 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:48 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422" returned: 0 in 0.485s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:28:48 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-022ce29a-b0f7-4a83-aea2-22d108ee511a" returned: 0 in 0.505s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-022ce29a-b0f7-4a83-aea2-22d108ee511a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a5f094-013d-4399-966f-89973506b772]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:48 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-022ce29a-b0f7-4a83-aea2-22d108ee511a Jul 23 22:28:48 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:48 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-559da8ce-a407-4235-a104-a01776654e6f tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce" returned: 0 in 0.478s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-559da8ce-a407-4235-a104-a01776654e6f tempest-VolumesDeleteCascade-1580014360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-603d941a-80fb-4a40-b508-51a447e49dc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:28:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-559da8ce-a407-4235-a104-a01776654e6f tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:48 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe Jul 23 22:28:48 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:48 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef 1G Jul 23 22:28:48 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:49 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-022ce29a-b0f7-4a83-aea2-22d108ee511a" returned: 0 in 0.305s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Lock "cinder-quobyte-022ce29a-b0f7-4a83-aea2-22d108ee511a" released by "delete_volume" :: held 0.884s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Created reservations ['d4706e39-cadb-4655-8eee-2429ef6d5eca', 'f593e9f0-837e-44c9-96cf-768ab601a9db', '597068bf-8425-4759-89b9-b3a46568a5a2', '373ed8d1-789c-4930-802d-e149b8fe88ee'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:49 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:49 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:49 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe" returned: 0 in 0.543s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:49 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 Jul 23 22:28:49 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:49 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-559da8ce-a407-4235-a104-a01776654e6f tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef 1G" returned: 0 in 0.576s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-559da8ce-a407-4235-a104-a01776654e6f tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:49 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef Jul 23 22:28:49 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:49 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.286s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:49 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Deleted volume successfully. Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4cbabce1-14fd-48c5-a47e-6f412ab4fe1e tempest-AttachVolumeNegativeTest-577220995 None] Lock "cinder-022ce29a-b0f7-4a83-aea2-22d108ee511a-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:49 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422" returned: 0 in 0.506s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:49 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-559da8ce-a407-4235-a104-a01776654e6f tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef" returned: 0 in 0.404s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:49 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-559da8ce-a407-4235-a104-a01776654e6f tempest-VolumesDeleteCascade-1580014360 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef is being set with open permissions: ugo+rw Jul 23 22:28:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-559da8ce-a407-4235-a104-a01776654e6f tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:49 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422 Jul 23 22:28:49 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:49 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef Jul 23 22:28:49 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:50 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.7009590a-1817-4917-97fb-69ad427f5422" returned: 0 in 0.290s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:50 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-559da8ce-a407-4235-a104-a01776654e6f tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef" returned: 0 in 0.292s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-quobyte-7009590a-1817-4917-97fb-69ad427f5422" released by "_delete_snapshot" :: held 2.032s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-quobyte-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" released by "delete_snapshot" :: held 2.140s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-559da8ce-a407-4235-a104-a01776654e6f tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:50 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-559da8ce-a407-4235-a104-a01776654e6f tempest-VolumesDeleteCascade-1580014360 None] Create snapshot completed successfully Jul 23 22:28:50 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Created reservations ['182018f5-feae-43a9-a271-20e8c32b9f94', '1b81b89a-51b1-419a-935f-86d6c66c4f2f', 'd0ffc043-7213-4600-aace-debdbf293bfb', '6523b605-6fe5-4f06-9323-458817b7227e'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:50 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Delete snapshot completed successfully. Jul 23 22:28:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6981e116-33d8-49b7-86f1-3bcc4b29f87f tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-7009590a-1817-4917-97fb-69ad427f5422-delete_snapshot" released by "delete_snapshot" :: held 2.409s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "cinder-cb14e181-ab49-48a7-befd-c31a2806f2dd-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Lock "cinder-cb14e181-ab49-48a7-befd-c31a2806f2dd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "cinder-quobyte-cb14e181-ab49-48a7-befd-c31a2806f2dd" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Lock "cinder-quobyte-cb14e181-ab49-48a7-befd-c31a2806f2dd" acquired by "delete_volume" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:50 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd7c546-dbd9-46b8-b171-3cdda93cff48]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb14e181-ab49-48a7-befd-c31a2806f2dd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:50 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb14e181-ab49-48a7-befd-c31a2806f2dd Jul 23 22:28:50 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:50 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb14e181-ab49-48a7-befd-c31a2806f2dd" returned: 0 in 0.385s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb14e181-ab49-48a7-befd-c31a2806f2dd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:50 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb14e181-ab49-48a7-befd-c31a2806f2dd Jul 23 22:28:50 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:51 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb14e181-ab49-48a7-befd-c31a2806f2dd" returned: 0 in 0.286s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Lock "cinder-quobyte-cb14e181-ab49-48a7-befd-c31a2806f2dd" released by "delete_volume" :: held 0.729s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "cinder-f616cc11-2c98-486d-9ee1-45a9dfed9dbe-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Created reservations ['58942148-a59d-4795-9915-9038777314dd', '686f1fdc-7103-4b97-baa1-be3b15559044', 'a0c72bd6-5ee1-4420-9bb3-50ee7d26b366', '8b6cde24-506c-49bb-aef8-f01fc8bd7acd'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-f616cc11-2c98-486d-9ee1-45a9dfed9dbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "cinder-quobyte-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-quobyte-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "cinder-quobyte-f616cc11-2c98-486d-9ee1-45a9dfed9dbe" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-quobyte-f616cc11-2c98-486d-9ee1-45a9dfed9dbe" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Deleting offline snapshot f616cc11-2c98-486d-9ee1-45a9dfed9dbe of volume c4c16bf0-9bac-4309-bccf-6bfd14c674e1 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] snapshot_file for this snap is: volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[33278087-5938-4945-9b24-f4849ab00683]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-603d941a-80fb-4a40-b508-51a447e49dc2-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:51 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:51 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-603d941a-80fb-4a40-b508-51a447e49dc2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Performing cascade delete. {{(pid=88308) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-0d7effcd-4f86-4603-89c7-f5732fe466ce-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-0d7effcd-4f86-4603-89c7-f5732fe466ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:51 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe Jul 23 22:28:51 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-quobyte-603d941a-80fb-4a40-b508-51a447e49dc2" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-603d941a-80fb-4a40-b508-51a447e49dc2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-quobyte-0d7effcd-4f86-4603-89c7-f5732fe466ce" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-0d7effcd-4f86-4603-89c7-f5732fe466ce" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Deleting offline snapshot 0d7effcd-4f86-4603-89c7-f5732fe466ce of volume 603d941a-80fb-4a40-b508-51a447e49dc2 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] snapshot_file for this snap is: volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[73909eab-2c63-4072-846a-a5b2f8c833a3]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:51 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.334s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:51 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Deleted volume successfully. Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-441b7215-256b-4e44-980b-f61cf4bd9e4c tempest-AttachVolumeNegativeTest-577220995 None] Lock "cinder-cb14e181-ab49-48a7-befd-c31a2806f2dd-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:51 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce Jul 23 22:28:51 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "cinder-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Lock "cinder-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=136,cinder:INSERT=42,cinder:UPDATE=188,cinder:DELETE=17 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:UPDATE=160,cinder:SELECT=135,cinder:INSERT=42,cinder:DELETE=14 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:28:52 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe" returned: 0 in 0.593s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f81840-fb6b-43b8-9d88-10f9e8087202]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "cinder-quobyte-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Lock "cinder-quobyte-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67" acquired by "delete_volume" :: waited 0.025s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d036af0-a1c6-46bc-95dc-f5db0bb37d16]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:52 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 Jul 23 22:28:52 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:52 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce" returned: 0 in 0.480s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-603d941a-80fb-4a40-b508-51a447e49dc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:28:52 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67 Jul 23 22:28:52 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6da107-a823-46a3-9134-136522f3f4a9]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:52 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 Jul 23 22:28:52 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:52 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" returned: 0 in 0.478s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:52 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67" returned: 0 in 0.420s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:52 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe Jul 23 22:28:52 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:52 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67 Jul 23 22:28:52 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:52 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2" returned: 0 in 0.603s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:52 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67" returned: 0 in 0.381s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Lock "cinder-quobyte-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67" released by "delete_volume" :: held 0.857s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3a8dc9-357f-48e4-8851-4583ab292f43]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Created reservations ['e4663586-3ee5-495b-b40e-ee1802489fb6', '60209336-336f-4cbe-8dcd-e6f3c15131dc', '716f9369-bbfc-48d9-bb60-28ba7dd09e73', '6a87a211-b3da-4e85-a90a-f85563345afe'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:53 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef Jul 23 22:28:53 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:53 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe" returned: 0 in 0.646s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:53 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:53 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:53 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe Jul 23 22:28:53 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:53 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef" returned: 0 in 0.510s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-603d941a-80fb-4a40-b508-51a447e49dc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe295bf-ff36-4a4c-9448-8d3656471d5e]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:53 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.350s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:53 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Deleted volume successfully. Jul 23 22:28:53 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1.f616cc11-2c98-486d-9ee1-45a9dfed9dbe" returned: 0 in 0.384s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ba44bd57-a0dc-4554-bd91-3acef28d0a5f tempest-AttachVolumeNegativeTest-577220995 None] Lock "cinder-9323e1e7-cde9-4f6b-aa5f-b5bc903bdd67-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:53 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce Jul 23 22:28:53 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-quobyte-f616cc11-2c98-486d-9ee1-45a9dfed9dbe" released by "_delete_snapshot" :: held 2.272s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-quobyte-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" released by "delete_snapshot" :: held 2.303s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Created reservations ['664ae0ea-c4a5-4b0b-9cfd-5994b566964d', '744a49a4-ca05-44fd-9df9-29f7bddf8f44', '9a017ebe-9230-446e-af89-d1aecfa7b9e4', '26e1a492-868b-439a-b1e6-e17cdf3b7fc1'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:53 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Delete snapshot completed successfully. Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b36c991f-05d4-46db-8b4c-a22c22b354e1 tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-f616cc11-2c98-486d-9ee1-45a9dfed9dbe-delete_snapshot" released by "delete_snapshot" :: held 2.505s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:53 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce" returned: 0 in 0.421s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-603d941a-80fb-4a40-b508-51a447e49dc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dea250-3975-4f24-84d1-289056b4335a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:54 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 Jul 23 22:28:54 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:54 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2" returned: 0 in 0.405s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:54 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce Jul 23 22:28:54 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "cinder-c4c16bf0-9bac-4309-bccf-6bfd14c674e1-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-c4c16bf0-9bac-4309-bccf-6bfd14c674e1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "cinder-quobyte-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-quobyte-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" acquired by "delete_volume" :: waited 0.026s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:54 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db48c86-e74e-4531-8df0-debbcbf8a9fc]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:54 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce" returned: 0 in 0.493s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:54 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce Jul 23 22:28:54 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:54 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 Jul 23 22:28:54 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:55 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.0d7effcd-4f86-4603-89c7-f5732fe466ce" returned: 0 in 0.344s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-603d941a-80fb-4a40-b508-51a447e49dc2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef -F qcow2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:55 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-603d941a-80fb-4a40-b508-51a447e49dc2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef -F qcow2 Jul 23 22:28:55 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:55 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" returned: 0 in 0.498s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:55 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1 Jul 23 22:28:55 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:55 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-603d941a-80fb-4a40-b508-51a447e49dc2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef -F qcow2" returned: 0 in 0.341s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-0d7effcd-4f86-4603-89c7-f5732fe466ce" released by "_delete_snapshot" :: held 3.850s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-603d941a-80fb-4a40-b508-51a447e49dc2" released by "delete_snapshot" :: held 3.891s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:55 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" returned: 0 in 0.298s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-quobyte-c4c16bf0-9bac-4309-bccf-6bfd14c674e1" released by "delete_volume" :: held 0.887s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Created reservations ['ca4feecc-b5bc-4f21-9b3d-5b90e1db94f9', '2e9bf62e-5da9-401a-a40d-b48d0f80de4f', 'd5b9f8d0-62b5-4c69-8c10-e655274fab8d', 'b4ae6443-d717-465d-928d-5213b98d27e2'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Created reservations ['4a73ea34-58c6-469b-8b74-6eadb34ec484', '5594969e-1823-4e6c-8b5f-0999aa125644', '073b0992-5981-41e6-8c9a-a05ca60ecaf6', 'f621be94-210d-4322-9c13-99baf1f5bb4b'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:55 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Delete snapshot completed successfully. Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-0d7effcd-4f86-4603-89c7-f5732fe466ce-delete_snapshot" released by "delete_snapshot" :: held 4.157s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-e0e10ab4-0db7-4405-be9a-dd19ecf14fef-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-e0e10ab4-0db7-4405-be9a-dd19ecf14fef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-quobyte-603d941a-80fb-4a40-b508-51a447e49dc2" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:55 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:55 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-603d941a-80fb-4a40-b508-51a447e49dc2" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-quobyte-e0e10ab4-0db7-4405-be9a-dd19ecf14fef" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-e0e10ab4-0db7-4405-be9a-dd19ecf14fef" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Deleting offline snapshot e0e10ab4-0db7-4405-be9a-dd19ecf14fef of volume 603d941a-80fb-4a40-b508-51a447e49dc2 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:28:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] snapshot_file for this snap is: volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:28:56 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[028ff157-9cf5-487a-9f65-9d864f8a3c22]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:56 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef Jul 23 22:28:56 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:56 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.599s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:56 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:56 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Deleted volume successfully. Jul 23 22:28:56 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef" returned: 0 in 0.462s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-603d941a-80fb-4a40-b508-51a447e49dc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:28:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-dd01690e-6c59-486a-b9a7-bfc7da88daee tempest-VolumesSnapshotListTestJSON-1899623150 None] Lock "cinder-c4c16bf0-9bac-4309-bccf-6bfd14c674e1-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:56 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f158d7fe-76cf-4779-b7f8-b46ed106784e]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:56 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 Jul 23 22:28:56 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:57 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2" returned: 0 in 0.481s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:57 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef Jul 23 22:28:57 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:57 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef" returned: 0 in 0.511s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:57 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef Jul 23 22:28:57 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:57 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2.e0e10ab4-0db7-4405-be9a-dd19ecf14fef" returned: 0 in 0.343s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-e0e10ab4-0db7-4405-be9a-dd19ecf14fef" released by "_delete_snapshot" :: held 1.976s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-603d941a-80fb-4a40-b508-51a447e49dc2" released by "delete_snapshot" :: held 2.004s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Created reservations ['ee9eb71d-d189-4596-a050-2cbca8fbe9fc', 'e9395b58-e70d-4591-a611-b3859b50c8fd', 'f9f60e4a-cc1c-412b-8ef3-00d157212dd2', 'e28450d9-f808-42c3-9c5c-deb1dc2a36ab'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:58 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Delete snapshot completed successfully. Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-e0e10ab4-0db7-4405-be9a-dd19ecf14fef-delete_snapshot" released by "delete_snapshot" :: held 2.278s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Snapshots deleted, issuing volume delete {{(pid=88308) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-quobyte-603d941a-80fb-4a40-b508-51a447e49dc2" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-603d941a-80fb-4a40-b508-51a447e49dc2" acquired by "delete_volume" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f00e5c-9e9d-45d5-bce7-6365e7b1a28f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:58 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 Jul 23 22:28:58 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Flow 'volume_create_manager' (5b4ec228-17fe-4adc-897b-2ccfd3372a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d870046b-d8b3-46ff-9f19-0b2d30940e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d870046b-d8b3-46ff-9f19-0b2d30940e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1647247307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8388d50a-4913-4f11-8109-e9a660d59743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265ce24f2d874a7daefb32e7b56dbbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:28:59Z,use_quota=True,user_id='0d65dc77f8104183af45e1a2f1ca0940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c741a50b-a6b2-4e73-b2f4-654a184de49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c741a50b-a6b2-4e73-b2f4-654a184de49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd135d93-1eab-4ee7-b1ea-a4f22cad7643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd135d93-1eab-4ee7-b1ea-a4f22cad7643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8388d50a-4913-4f11-8109-e9a660d59743', 'volume_name': 'volume-8388d50a-4913-4f11-8109-e9a660d59743', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:58 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e3970b-6b79-49cd-ab9a-0160a50d776e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e3970b-6b79-49cd-ab9a-0160a50d776e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed83296-7984-4074-b86c-abef36549e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:28:58 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Volume 8388d50a-4913-4f11-8109-e9a660d59743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8388d50a-4913-4f11-8109-e9a660d59743', 'volume_size': 1} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1647247307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8388d50a-4913-4f11-8109-e9a660d59743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265ce24f2d874a7daefb32e7b56dbbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:28:59Z,use_quota=True,user_id='0d65dc77f8104183af45e1a2f1ca0940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Creating volume 8388d50a-4913-4f11-8109-e9a660d59743 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:28:58 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2" returned: 0 in 0.573s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:58 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743 1073741824 Jul 23 22:28:58 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:58 devstack sudo[100648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2 Jul 23 22:28:58 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:59 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-603d941a-80fb-4a40-b508-51a447e49dc2" returned: 0 in 0.414s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-603d941a-80fb-4a40-b508-51a447e49dc2" released by "delete_volume" :: held 1.077s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:59 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Created reservations ['89421151-7aa2-44b6-98c8-798032d12230', 'e90cd5d5-b4da-43ba-9900-a700b6e0e1ce', '726e83e7-0150-49e1-b7bd-890a9da088f1', '762c91a5-ef7b-49fe-a161-9db30e1f11dc'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:28:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:28:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:28:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:28:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:28:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:28:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:59 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:28:59 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:59 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743 1073741824" returned: 0 in 0.803s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:28:59 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743 Jul 23 22:28:59 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:28:59 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Jul 23 22:28:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.339s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:28:59 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:28:59 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Deleted volume successfully. Jul 23 22:28:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4fe804ba-c27c-4404-8119-1ec91b12b950 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-603d941a-80fb-4a40-b508-51a447e49dc2-delete_volume" released by "delete_volume" :: held 8.294s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:28:59 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743" returned: 0 in 0.367s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed83296-7984-4074-b86c-abef36549e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8388d50a-4913-4f11-8109-e9a660d59743', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eff4863-7352-4972-851c-37ba403eb87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:00 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Volume volume-8388d50a-4913-4f11-8109-e9a660d59743 (8388d50a-4913-4f11-8109-e9a660d59743): created successfully Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eff4863-7352-4972-851c-37ba403eb87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Flow 'volume_create_manager' (5b4ec228-17fe-4adc-897b-2ccfd3372a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:00 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c5270e62-fd54-45f5-9e43-c99334096890 tempest-VolumesSnapshotTestJSON-1747862965 None] Created volume successfully. Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Flow 'volume_create_manager' (e3ce1582-32b4-4441-ba01-e45e27a4e02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae0264f1-1e04-40ba-94a1-81da0609c45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae0264f1-1e04-40ba-94a1-81da0609c45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1454399481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b37123-0559-466e-affe-bb19dfd28d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6773fb63e045a497ba490ce7c899a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:01Z,use_quota=True,user_id='bd5c7f9d3d2f41fb9619ec77db49f732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11fa8f0b-dc60-4015-9b22-17ccc269b4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11fa8f0b-dc60-4015-9b22-17ccc269b4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5043a60-8502-4c23-8c86-911f884512ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5043a60-8502-4c23-8c86-911f884512ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38b37123-0559-466e-affe-bb19dfd28d21', 'volume_name': 'volume-38b37123-0559-466e-affe-bb19dfd28d21', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dae1bf1-6ff7-4ef0-a71f-0fb381a57180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dae1bf1-6ff7-4ef0-a71f-0fb381a57180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b959714c-025d-4789-953d-ce12828e6484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:00 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Volume 38b37123-0559-466e-affe-bb19dfd28d21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38b37123-0559-466e-affe-bb19dfd28d21', 'volume_size': 1} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1454399481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b37123-0559-466e-affe-bb19dfd28d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6773fb63e045a497ba490ce7c899a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:01Z,use_quota=True,user_id='bd5c7f9d3d2f41fb9619ec77db49f732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Creating volume 38b37123-0559-466e-affe-bb19dfd28d21 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:29:00 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:29:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:00 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 1073741824 Jul 23 22:29:00 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Flow 'volume_create_manager' (3130c8c9-2064-41db-9d11-dcfe92c81b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700bf191-8b1e-4925-a8bd-0db7f8789a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700bf191-8b1e-4925-a8bd-0db7f8789a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1878171046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3fc915-171c-48ff-bbd5-c6bc88bbbf94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e8615c50994cd3932f647efb51ab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:01Z,use_quota=True,user_id='63277ec60ab046db8117fd605e2c3656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2f7e8c-8e9a-4959-9db7-7581f3fed355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2f7e8c-8e9a-4959-9db7-7581f3fed355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcd6ddb-5658-49a4-84e4-c442b31ee3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:01 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcd6ddb-5658-49a4-84e4-c442b31ee3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a3fc915-171c-48ff-bbd5-c6bc88bbbf94', 'volume_name': 'volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94', 'volume_size': 2}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bf0bab-0dc2-4f24-a09b-f1603cbd6d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bf0bab-0dc2-4f24-a09b-f1603cbd6d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8abebe74-a06a-49c1-8afd-947b7b46be57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:01 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Volume 5a3fc915-171c-48ff-bbd5-c6bc88bbbf94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94', 'volume_size': 2} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 1073741824" returned: 0 in 0.617s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:01 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 Jul 23 22:29:01 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:01 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21" returned: 0 in 0.266s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.410s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] Creating offline snapshot 4417383f-7c1b-42a3-8e5c-91f422b63e86 of volume 8388d50a-4913-4f11-8109-e9a660d59743 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b959714c-025d-4789-953d-ce12828e6484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38b37123-0559-466e-affe-bb19dfd28d21', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2642f7e-7269-46e7-a162-81dbb05b1939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3550a8-226e-4e1c-8ab6-ae518f097477]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:01 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Volume volume-38b37123-0559-466e-affe-bb19dfd28d21 (38b37123-0559-466e-affe-bb19dfd28d21): created successfully Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2642f7e-7269-46e7-a162-81dbb05b1939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Flow 'volume_create_manager' (e3ce1582-32b4-4441-ba01-e45e27a4e02b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:01 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e32b05d4-cec7-4e21-8e77-94bf2625bf0f tempest-VolumesDeleteCascade-1580014360 None] Created volume successfully. Jul 23 22:29:01 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743 Jul 23 22:29:01 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:02 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743" returned: 0 in 0.377s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:02 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86 1G Jul 23 22:29:02 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:02 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86 1G" returned: 0 in 0.441s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8388d50a-4913-4f11-8109-e9a660d59743 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:02 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8388d50a-4913-4f11-8109-e9a660d59743 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86 Jul 23 22:29:02 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:02 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8388d50a-4913-4f11-8109-e9a660d59743 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86" returned: 0 in 0.337s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:02 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86 is being set with open permissions: ugo+rw Jul 23 22:29:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:02 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86 Jul 23 22:29:02 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:03 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86" returned: 0 in 0.251s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:03 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.info Jul 23 22:29:03 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:03 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.info" returned: 0 in 0.257s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:03 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.info is being set with open permissions: ugo+rw Jul 23 22:29:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:03 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.info Jul 23 22:29:03 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:03 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.info" returned: 0 in 0.256s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.323s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1878171046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3fc915-171c-48ff-bbd5-c6bc88bbbf94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e8615c50994cd3932f647efb51ab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:01Z,use_quota=True,user_id='63277ec60ab046db8117fd605e2c3656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:29:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Creating volume 5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:29:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:29:03 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:29:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 2147483648 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:03 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 2147483648 Jul 23 22:29:03 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:03 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4c677cea-1fa2-47ab-a201-554f95dde321 tempest-VolumesSnapshotTestJSON-1747862965 None] Create snapshot completed successfully Jul 23 22:29:04 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 2147483648" returned: 0 in 0.535s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:04 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 Jul 23 22:29:04 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-4417383f-7c1b-42a3-8e5c-91f422b63e86-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-4417383f-7c1b-42a3-8e5c-91f422b63e86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-quobyte-8388d50a-4913-4f11-8109-e9a660d59743" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-8388d50a-4913-4f11-8109-e9a660d59743" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-quobyte-4417383f-7c1b-42a3-8e5c-91f422b63e86" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-4417383f-7c1b-42a3-8e5c-91f422b63e86" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Deleting offline snapshot 4417383f-7c1b-42a3-8e5c-91f422b63e86 of volume 8388d50a-4913-4f11-8109-e9a660d59743 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:29:04 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] snapshot_file for this snap is: volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94" returned: 0 in 0.360s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.804s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecbfa9d-9df0-4578-81fe-71a3dd3b6462]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8abebe74-a06a-49c1-8afd-947b7b46be57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94', 'volume_size': 2}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32044a33-8f5b-4325-84ff-e3644754758d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] Creating offline snapshot 0778b54e-a52e-4c93-b742-149963a02742 of volume 38b37123-0559-466e-affe-bb19dfd28d21 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:29:04 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Volume volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 (5a3fc915-171c-48ff-bbd5-c6bc88bbbf94): created successfully Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32044a33-8f5b-4325-84ff-e3644754758d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Flow 'volume_create_manager' (3130c8c9-2064-41db-9d11-dcfe92c81b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d650af4b-9f7f-4166-ba45-0a60e663ee29]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:04 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2d7fc5a9-ab66-4e05-9868-4a043546b5af tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Created volume successfully. Jul 23 22:29:04 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86 Jul 23 22:29:04 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:04 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 Jul 23 22:29:04 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:05 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86" returned: 0 in 0.457s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:05 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8388d50a-4913-4f11-8109-e9a660d59743(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:29:05 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d54f4b-9be3-43d6-87d3-61c1df433483]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:05 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21" returned: 0 in 0.527s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:05 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743 Jul 23 22:29:05 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:05 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 1G Jul 23 22:29:05 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:05 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743" returned: 0 in 0.511s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:05 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86 Jul 23 22:29:05 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:05 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 1G" returned: 0 in 0.520s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b37123-0559-466e-affe-bb19dfd28d21 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:05 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b37123-0559-466e-affe-bb19dfd28d21 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 Jul 23 22:29:05 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:06 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86" returned: 0 in 0.386s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:06 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86 Jul 23 22:29:06 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:06 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b37123-0559-466e-affe-bb19dfd28d21 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742" returned: 0 in 0.387s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:06 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 is being set with open permissions: ugo+rw Jul 23 22:29:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:06 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 Jul 23 22:29:06 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:06 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743.4417383f-7c1b-42a3-8e5c-91f422b63e86" returned: 0 in 0.288s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:06 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-4417383f-7c1b-42a3-8e5c-91f422b63e86" released by "_delete_snapshot" :: held 1.781s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:06 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-8388d50a-4913-4f11-8109-e9a660d59743" released by "delete_snapshot" :: held 1.806s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:06 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742" returned: 0 in 0.307s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:06 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Created reservations ['35dd63d4-3df1-4bed-8fdd-1d04edc50236', '37928f51-bb40-4116-954a-45c49eff841b', '06581f37-d94b-4214-97c2-3c4e125270d6', '9b47d4e1-d85b-4b57-b160-463cf5402e69'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:06 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.info Jul 23 22:29:06 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:06 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Delete snapshot completed successfully. Jul 23 22:29:06 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad4155f5-3009-48f2-a250-0db021dd7928 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-4417383f-7c1b-42a3-8e5c-91f422b63e86-delete_snapshot" released by "delete_snapshot" :: held 2.068s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:06 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.info" returned: 0 in 0.299s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:06 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.info is being set with open permissions: ugo+rw Jul 23 22:29:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:06 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.info Jul 23 22:29:06 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:07 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.info" returned: 0 in 0.319s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.520s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.556s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Creating offline snapshot 46bde829-c868-4ac6-9019-65416f57c295 of volume 5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:29:07 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-26be0339-a599-4357-9205-a1b373660d63 tempest-VolumesDeleteCascade-1580014360 None] Create snapshot completed successfully Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b405cbd-6fe7-4518-b0ac-f95635741baa]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Flow 'volume_create_manager' (9315268d-ffb3-4539-9866-dad78a043bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217a865a-b16b-4f45-ae65-15ff345638fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217a865a-b16b-4f45-ae65-15ff345638fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1466109724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265ce24f2d874a7daefb32e7b56dbbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:07Z,use_quota=True,user_id='0d65dc77f8104183af45e1a2f1ca0940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35435c3-0c8d-4564-a1c6-9206e915e1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35435c3-0c8d-4564-a1c6-9206e915e1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38ef7f9-5bc1-4aa4-8c53-699c865dab0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38ef7f9-5bc1-4aa4-8c53-699c865dab0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4', 'volume_name': 'volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b435998-1b9f-4466-a2f7-bf9363776831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b435998-1b9f-4466-a2f7-bf9363776831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:07 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 Jul 23 22:29:07 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1443db-e4ba-4425-ae84-24497a2ce615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:07 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Volume 706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4', 'volume_size': 1} Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:07 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94" returned: 0 in 0.391s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295 2G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:07 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295 2G Jul 23 22:29:07 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:08 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295 2G" returned: 0 in 0.430s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:08 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295 Jul 23 22:29:08 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:08 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295" returned: 0 in 0.381s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:08 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295 is being set with open permissions: ugo+rw Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:08 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295 Jul 23 22:29:08 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:29:08 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Flow 'volume_create_manager' (b8f2f630-b66b-4370-9ae0-30859db484d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cff238-efd5-4b2b-a54d-75b275ae08cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295" returned: 0 in 0.401s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cff238-efd5-4b2b-a54d-75b275ae08cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1194128915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9a54fe-78c9-4cf7-998a-64559000a953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf6773fb63e045a497ba490ce7c899a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0778b54e-a52e-4c93-b742-149963a02742,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:09Z,use_quota=True,user_id='bd5c7f9d3d2f41fb9619ec77db49f732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9efb2e7f-ee87-49af-9ffa-4a3c17ee867e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9efb2e7f-ee87-49af-9ffa-4a3c17ee867e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed92c89c-9288-4fcc-a42f-81ff829de08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed92c89c-9288-4fcc-a42f-81ff829de08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0a9a54fe-78c9-4cf7-998a-64559000a953', 'volume_name': 'volume-0a9a54fe-78c9-4cf7-998a-64559000a953', 'volume_size': 1, 'snapshot_id': '0778b54e-a52e-4c93-b742-149963a02742'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585e8e5b-33f8-47d8-bf21-ca757c883bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585e8e5b-33f8-47d8-bf21-ca757c883bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d60525-acdc-4ac6-a866-6584246db943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:08 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Volume 0a9a54fe-78c9-4cf7-998a-64559000a953: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0a9a54fe-78c9-4cf7-998a-64559000a953', 'volume_size': 1, 'snapshot_id': '0778b54e-a52e-4c93-b742-149963a02742'} Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:08 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.info Jul 23 22:29:08 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:09 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.info" returned: 0 in 0.288s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:09 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.info is being set with open permissions: ugo+rw Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:09 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.info Jul 23 22:29:09 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:09 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-584fbf74-0c33-4ad9-bb05-37bbe974bc5a tempest-GroupsV320Test-45725578 None] Group tempest-GroupsV320Test-Group-1585951858: creating Jul 23 22:29:09 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-584fbf74-0c33-4ad9-bb05-37bbe974bc5a tempest-GroupsV320Test-45725578 None] Group tempest-GroupsV320Test-Group-1585951858: created successfully Jul 23 22:29:09 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-584fbf74-0c33-4ad9-bb05-37bbe974bc5a tempest-GroupsV320Test-45725578 None] Create group completed successfully. Jul 23 22:29:09 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.info" returned: 0 in 0.273s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.138s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1466109724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265ce24f2d874a7daefb32e7b56dbbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:07Z,use_quota=True,user_id='0d65dc77f8104183af45e1a2f1ca0940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Creating volume 706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:29:09 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:09 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 1073741824 Jul 23 22:29:09 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:09 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f327607b-1422-4b0c-bd06-70f48d775d63 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Create snapshot completed successfully Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Acquiring lock "cinder-46bde829-c868-4ac6-9019-65416f57c295-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "cinder-46bde829-c868-4ac6-9019-65416f57c295-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Acquiring lock "cinder-quobyte-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "cinder-quobyte-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Acquiring lock "cinder-quobyte-46bde829-c868-4ac6-9019-65416f57c295" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "cinder-quobyte-46bde829-c868-4ac6-9019-65416f57c295" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Deleting offline snapshot 46bde829-c868-4ac6-9019-65416f57c295 of volume 5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] snapshot_file for this snap is: volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6570b38f-366e-4d77-beed-f7c52ba7b190]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:09 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 1073741824" returned: 0 in 0.483s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:10 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 Jul 23 22:29:10 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:10 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295 Jul 23 22:29:10 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:10 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4" returned: 0 in 0.259s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.377s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-quobyte-0778b54e-a52e-4c93-b742-149963a02742-0a9a54fe-78c9-4cf7-998a-64559000a953" by "_create_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1443db-e4ba-4425-ae84-24497a2ce615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5684dfb1-d1f1-4f35-b1d9-f756828d5a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-0778b54e-a52e-4c93-b742-149963a02742-0a9a54fe-78c9-4cf7-998a-64559000a953" acquired by "_create_volume_from_snapshot" :: waited 0.056s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Creating volume 0a9a54fe-78c9-4cf7-998a-64559000a953 from snapshot 0778b54e-a52e-4c93-b742-149963a02742 {{(pid=88308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:10 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-quobyte-0a9a54fe-78c9-4cf7-998a-64559000a953" by "_copy_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:10 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Volume volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 (706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4): created successfully Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5684dfb1-d1f1-4f35-b1d9-f756828d5a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Flow 'volume_create_manager' (9315268d-ffb3-4539-9866-dad78a043bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295" returned: 0 in 0.462s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-0a9a54fe-78c9-4cf7-998a-64559000a953" acquired by "_copy_volume_from_snapshot" :: waited 0.100s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] snapshot: 0778b54e-a52e-4c93-b742-149963a02742, volume: 0a9a54fe-78c9-4cf7-998a-64559000a953, {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7053a82-9b0f-46fd-81a4-fa4d5f045b38]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:10 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-40dc9307-80bc-4de5-acf1-f93e9015036a tempest-VolumesSnapshotTestJSON-1747862965 None] Created volume successfully. Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[813a7dc0-9210-4351-9a99-a550fdd332c8]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:10 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 Jul 23 22:29:10 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:10 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 Jul 23 22:29:10 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:10 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94" returned: 0 in 0.485s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:11 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:11 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295 Jul 23 22:29:11 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742" returned: 0 in 0.428s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38b37123-0559-466e-affe-bb19dfd28d21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Creating direct copy from snapshot {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d5f792-6c69-4a10-a912-0dc127546b64]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-1197a835-1f7f-432d-959c-e1b8164eb9e0 tempest-GroupsV320Test-45725578 None] Created reservations ['8e402331-ead1-4fe6-8b79-33a239ae9995'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1197a835-1f7f-432d-959c-e1b8164eb9e0 tempest-GroupsV320Test-45725578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1197a835-1f7f-432d-959c-e1b8164eb9e0 tempest-GroupsV320Test-45725578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1197a835-1f7f-432d-959c-e1b8164eb9e0 tempest-GroupsV320Test-45725578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1197a835-1f7f-432d-959c-e1b8164eb9e0 tempest-GroupsV320Test-45725578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1197a835-1f7f-432d-959c-e1b8164eb9e0 tempest-GroupsV320Test-45725578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1197a835-1f7f-432d-959c-e1b8164eb9e0 tempest-GroupsV320Test-45725578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:11 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:29:11 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:11 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 Jul 23 22:29:11 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:11 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295" returned: 0 in 0.338s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:11 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295 Jul 23 22:29:11 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:11 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1197a835-1f7f-432d-959c-e1b8164eb9e0 tempest-GroupsV320Test-45725578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.277s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-1197a835-1f7f-432d-959c-e1b8164eb9e0 tempest-GroupsV320Test-45725578 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:29:11 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-1197a835-1f7f-432d-959c-e1b8164eb9e0 tempest-GroupsV320Test-45725578 None] Delete group completed successfully. Jul 23 22:29:11 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21" returned: 0 in 0.405s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG cinder.utils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Path /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0a9a54fe-78c9-4cf7-998a-64559000a953 not found in is_blk_device check {{(pid=88308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0a9a54fe-78c9-4cf7-998a-64559000a953 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:11 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0a9a54fe-78c9-4cf7-998a-64559000a953 Jul 23 22:29:11 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:11 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94.46bde829-c868-4ac6-9019-65416f57c295" returned: 0 in 0.271s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "cinder-quobyte-46bde829-c868-4ac6-9019-65416f57c295" released by "_delete_snapshot" :: held 1.705s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "cinder-quobyte-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94" released by "delete_snapshot" :: held 1.735s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Created reservations ['1a95bf29-c676-4c0d-b1b9-a53a3ee117ef', '17955cc8-bb16-4d81-8a2f-6e059a813d82', '4dc20a9c-311c-429c-b44a-28deed2cb232', 'eb55045f-bac0-43f7-a9a0-d1198dd80426'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:11 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Delete snapshot completed successfully. Jul 23 22:29:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-08d26edc-b80e-465e-b768-ca144bdc5d7a tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "cinder-46bde829-c868-4ac6-9019-65416f57c295-delete_snapshot" released by "delete_snapshot" :: held 1.925s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Acquiring lock "cinder-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "cinder-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Acquiring lock "cinder-quobyte-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "cinder-quobyte-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94" acquired by "delete_volume" :: waited 0.043s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:12 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9282f6e5-1b58-401d-8e6b-08b045577dca]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:12 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 Jul 23 22:29:12 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:13 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94" returned: 0 in 0.849s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:13 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94 Jul 23 22:29:13 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:14 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94" returned: 0 in 0.856s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "cinder-quobyte-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94" released by "delete_volume" :: held 1.884s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:14 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Created reservations ['4d8c0d52-c403-4c6f-a0ca-ebf3aac8427d', 'a3a41260-556f-4825-8fa9-2e9833fd45df', 'ea81444a-b373-4932-b665-a8e46f6bfe40', '3e98c0f5-3c75-45bb-9157-d08f5e6e9cbd'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:14 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:14 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:14 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:29:14 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:15 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.678s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:15 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:29:15 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Deleted volume successfully. Jul 23 22:29:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ce0dee0-d768-4daa-83eb-90ee61d34494 tempest-VolumesSnapshotNegativeTestJSON-1322747775 None] Lock "cinder-5a3fc915-171c-48ff-bbd5-c6bc88bbbf94-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:16 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0a9a54fe-78c9-4cf7-998a-64559000a953" returned: 0 in 5.447s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:16 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8714c1b6-749f-4f46-9f27-40d514cc0992]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:17 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 Jul 23 22:29:17 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:17 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21" returned: 0 in 0.597s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:17 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21, size 1024.00 MB, duration 5.45 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0a9a54fe-78c9-4cf7-998a-64559000a953 {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:29:17 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Converted 1024.00 MB image at 187.94 MB/s Jul 23 22:29:17 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0a9a54fe-78c9-4cf7-998a-64559000a953 is being set with open permissions: ugo+rw Jul 23 22:29:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0a9a54fe-78c9-4cf7-998a-64559000a953 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:17 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0a9a54fe-78c9-4cf7-998a-64559000a953 Jul 23 22:29:17 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:17 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0a9a54fe-78c9-4cf7-998a-64559000a953" returned: 0 in 0.268s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-0a9a54fe-78c9-4cf7-998a-64559000a953" released by "_copy_volume_from_snapshot" :: held 7.295s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-0778b54e-a52e-4c93-b742-149963a02742-0a9a54fe-78c9-4cf7-998a-64559000a953" released by "_create_volume_from_snapshot" :: held 7.431s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.489s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] Creating offline snapshot b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 of volume 706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:29:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d60525-acdc-4ac6-a866-6584246db943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a9a54fe-78c9-4cf7-998a-64559000a953', 'volume_size': 1, 'snapshot_id': '0778b54e-a52e-4c93-b742-149963a02742'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86315075-ab17-4d3d-bb6d-a6e6bfd0f172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:17 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b94061b-42ea-4ac0-a663-cf2f8f65be66]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:17 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Volume volume-0a9a54fe-78c9-4cf7-998a-64559000a953 (0a9a54fe-78c9-4cf7-998a-64559000a953): created successfully Jul 23 22:29:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86315075-ab17-4d3d-bb6d-a6e6bfd0f172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Flow 'volume_create_manager' (b8f2f630-b66b-4370-9ae0-30859db484d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:17 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-af05c293-2ba6-4f73-95f5-328cab65c930 tempest-VolumesDeleteCascade-1580014360 None] Created volume successfully. Jul 23 22:29:18 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 Jul 23 22:29:18 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:18 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4" returned: 0 in 0.448s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:18 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 1G Jul 23 22:29:18 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:18 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 1G" returned: 0 in 0.459s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:18 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 Jul 23 22:29:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-38b37123-0559-466e-affe-bb19dfd28d21-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:18 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-38b37123-0559-466e-affe-bb19dfd28d21-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Performing cascade delete. {{(pid=88308) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 23 22:29:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-0778b54e-a52e-4c93-b742-149963a02742-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-0778b54e-a52e-4c93-b742-149963a02742-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-quobyte-38b37123-0559-466e-affe-bb19dfd28d21" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-38b37123-0559-466e-affe-bb19dfd28d21" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-quobyte-0778b54e-a52e-4c93-b742-149963a02742" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-0778b54e-a52e-4c93-b742-149963a02742" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Deleting offline snapshot 0778b54e-a52e-4c93-b742-149963a02742 of volume 38b37123-0559-466e-affe-bb19dfd28d21 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:29:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] snapshot_file for this snap is: volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:29:19 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7748b5-f9c2-440c-ac58-39549511af9b]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:19 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 Jul 23 22:29:19 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:19 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7" returned: 0 in 0.412s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:19 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 is being set with open permissions: ugo+rw Jul 23 22:29:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:19 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 Jul 23 22:29:19 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:19 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7" returned: 0 in 0.315s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:19 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742" returned: 0 in 0.504s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38b37123-0559-466e-affe-bb19dfd28d21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:29:19 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d820c259-e18e-48cc-829b-d9d9b4447e50]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:19 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.info Jul 23 22:29:19 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:19 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 Jul 23 22:29:19 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:19 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.info" returned: 0 in 0.344s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:19 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.info is being set with open permissions: ugo+rw Jul 23 22:29:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:19 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.info Jul 23 22:29:19 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:20 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21" returned: 0 in 0.490s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:20 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 Jul 23 22:29:20 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:29:20 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Flow 'volume_create_manager' (c68616c6-ee07-4ae6-8180-1318b26ee468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5be2704-88ad-4acd-8d75-a72223d1d712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.info" returned: 0 in 0.323s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.455s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5be2704-88ad-4acd-8d75-a72223d1d712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1970470268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cfd68d6-657d-41e6-a35f-2b87333af08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524a7e503bf646558379a2192b132912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:20Z,use_quota=True,user_id='360c4a08d1834394be16ce08a96a8364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b769bbb-69d5-4d6b-926f-0cac5bbe82fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b769bbb-69d5-4d6b-926f-0cac5bbe82fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2bca86b-6252-40ad-8e48-95094f20ebfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2bca86b-6252-40ad-8e48-95094f20ebfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cfd68d6-657d-41e6-a35f-2b87333af08e', 'volume_name': 'volume-8cfd68d6-657d-41e6-a35f-2b87333af08e', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3762d78d-d2f2-4231-9b4f-22e23255817c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3762d78d-d2f2-4231-9b4f-22e23255817c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f371576-e8fd-423a-ad94-8b3fe7dad617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:20 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume 8cfd68d6-657d-41e6-a35f-2b87333af08e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cfd68d6-657d-41e6-a35f-2b87333af08e', 'volume_size': 1} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1970470268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cfd68d6-657d-41e6-a35f-2b87333af08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524a7e503bf646558379a2192b132912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:20Z,use_quota=True,user_id='360c4a08d1834394be16ce08a96a8364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Creating volume 8cfd68d6-657d-41e6-a35f-2b87333af08e {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:29:20 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:20 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-11216d7b-99bd-46ff-bb97-8409fb35771d tempest-VolumesSnapshotTestJSON-1747862965 None] Create snapshot completed successfully Jul 23 22:29:20 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e 1073741824 Jul 23 22:29:20 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:20 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742" returned: 0 in 0.419s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:20 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742 Jul 23 22:29:20 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:20 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21.0778b54e-a52e-4c93-b742-149963a02742" returned: 0 in 0.331s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-0778b54e-a52e-4c93-b742-149963a02742" released by "_delete_snapshot" :: held 1.858s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-38b37123-0559-466e-affe-bb19dfd28d21" released by "delete_snapshot" :: held 1.884s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:20 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e 1073741824" returned: 0 in 0.535s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Created reservations ['9ece1aa7-0285-4563-9c50-58f57b5519c0', '44faa87d-94ce-4c09-a056-6c1281d9b6a7', 'c2047c3c-6417-48f0-8396-78baa44e401e', '7dde0177-b598-496c-8dd6-b660029582a6'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:20 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e Jul 23 22:29:20 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:20 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Delete snapshot completed successfully. Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-0778b54e-a52e-4c93-b742-149963a02742-delete_snapshot" released by "delete_snapshot" :: held 2.083s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Snapshots deleted, issuing volume delete {{(pid=88308) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 23 22:29:20 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-quobyte-38b37123-0559-466e-affe-bb19dfd28d21" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-38b37123-0559-466e-affe-bb19dfd28d21" acquired by "delete_volume" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3472511-a0a3-4168-9e75-f94c30707816]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:21 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e" returned: 0 in 0.294s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:21 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 Jul 23 22:29:21 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f371576-e8fd-423a-ad94-8b3fe7dad617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cfd68d6-657d-41e6-a35f-2b87333af08e', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f27fb16-e71f-47f8-a9ab-ecd5fffc2c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:21 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume volume-8cfd68d6-657d-41e6-a35f-2b87333af08e (8cfd68d6-657d-41e6-a35f-2b87333af08e): created successfully Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f27fb16-e71f-47f8-a9ab-ecd5fffc2c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Flow 'volume_create_manager' (c68616c6-ee07-4ae6-8180-1318b26ee468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:21 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c2d72f1a-b412-44dd-8bc4-6f754f137ec7 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Created volume successfully. Jul 23 22:29:21 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21" returned: 0 in 0.402s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:21 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21 Jul 23 22:29:21 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:21 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-38b37123-0559-466e-affe-bb19dfd28d21" returned: 0 in 0.273s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-38b37123-0559-466e-affe-bb19dfd28d21" released by "delete_volume" :: held 0.775s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Created reservations ['f05c1712-d094-408d-8d8e-e85d3c8dd3cf', '4b2fad89-572f-4d49-942f-d78f142b3dc8', 'e93d6ede-2f2b-4ed7-a1bc-811b3bc43ddb', '4b6e7f36-fdcc-40cf-8aac-bc6bf19ff10c'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:22 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:29:22 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Flow 'volume_create_manager' (ed3b92d5-e64e-43cd-bcbf-b7bfdc700700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1deeec97-7789-4862-89e2-d77c7e736e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1deeec97-7789-4862-89e2-d77c7e736e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1438828048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0718059a-a941-4cf4-a8a3-64e24e722fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265ce24f2d874a7daefb32e7b56dbbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:22Z,use_quota=True,user_id='0d65dc77f8104183af45e1a2f1ca0940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d39b3e2-1aa8-4a43-9873-a7c0d52049b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d39b3e2-1aa8-4a43-9873-a7c0d52049b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a49266f-fb78-4ec6-beb8-3f1bce0d0f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a49266f-fb78-4ec6-beb8-3f1bce0d0f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0718059a-a941-4cf4-a8a3-64e24e722fcd', 'volume_name': 'volume-0718059a-a941-4cf4-a8a3-64e24e722fcd', 'volume_size': 2, 'snapshot_id': 'b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5672ff6b-57ac-41f2-ba35-190acd52e99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5672ff6b-57ac-41f2-ba35-190acd52e99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a82809-d1d0-421e-bd7d-3a4da7387c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:22 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Volume 0718059a-a941-4cf4-a8a3-64e24e722fcd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0718059a-a941-4cf4-a8a3-64e24e722fcd', 'volume_size': 2, 'snapshot_id': 'b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7'} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-quobyte-b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7-0718059a-a941-4cf4-a8a3-64e24e722fcd" by "_create_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7-0718059a-a941-4cf4-a8a3-64e24e722fcd" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Creating volume 0718059a-a941-4cf4-a8a3-64e24e722fcd from snapshot b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 {{(pid=88308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:22 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-quobyte-0718059a-a941-4cf4-a8a3-64e24e722fcd" by "_copy_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.373s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:29:22 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Deleted volume successfully. Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-0718059a-a941-4cf4-a8a3-64e24e722fcd" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] snapshot: b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7, volume: 0718059a-a941-4cf4-a8a3-64e24e722fcd, {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-02f2670a-7220-4c47-9d6e-cfc6e48d3cc3 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-38b37123-0559-466e-affe-bb19dfd28d21-delete_volume" released by "delete_volume" :: held 3.594s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-0a9a54fe-78c9-4cf7-998a-64559000a953-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b136424-e2fa-4438-bde0-df70080db556]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-0a9a54fe-78c9-4cf7-998a-64559000a953-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "cinder-quobyte-0a9a54fe-78c9-4cf7-998a-64559000a953" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-0a9a54fe-78c9-4cf7-998a-64559000a953" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b51f20-a630-49d6-ab47-92016c0e278c]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0a9a54fe-78c9-4cf7-998a-64559000a953 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:22 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 Jul 23 22:29:22 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:22 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0a9a54fe-78c9-4cf7-998a-64559000a953 Jul 23 22:29:22 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:22 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7" returned: 0 in 0.428s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Creating direct copy from snapshot {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ffedac-a1b6-4470-8890-12f0542d2f24]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0a9a54fe-78c9-4cf7-998a-64559000a953" returned: 0 in 0.432s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:23 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0a9a54fe-78c9-4cf7-998a-64559000a953 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:23 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0a9a54fe-78c9-4cf7-998a-64559000a953 Jul 23 22:29:23 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:23 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 Jul 23 22:29:23 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:23 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0a9a54fe-78c9-4cf7-998a-64559000a953" returned: 0 in 0.277s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-quobyte-0a9a54fe-78c9-4cf7-998a-64559000a953" released by "delete_volume" :: held 0.756s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:23 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4" returned: 0 in 0.438s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG cinder.utils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Path /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0718059a-a941-4cf4-a8a3-64e24e722fcd not found in is_blk_device check {{(pid=88308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0718059a-a941-4cf4-a8a3-64e24e722fcd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Created reservations ['a9a54363-7222-4fbe-ba73-aa090789e84c', '08298d03-7320-4c0d-a402-0830d3baaae1', 'd964f1c1-8f93-4e26-92a6-a8932b4b33a8', '4427dfff-5ccd-4e38-9529-ab15ec5e6611'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:23 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0718059a-a941-4cf4-a8a3-64e24e722fcd Jul 23 22:29:23 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:23 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:29:23 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:23 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.308s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:29:23 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Deleted volume successfully. Jul 23 22:29:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a3f80ade-c76d-4490-bb8a-e172b1570041 tempest-VolumesDeleteCascade-1580014360 None] Lock "cinder-0a9a54fe-78c9-4cf7-998a-64559000a953-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:29:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:26 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:29:26 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:26 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.545s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:29:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:29:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 29 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:29:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:29:28 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0718059a-a941-4cf4-a8a3-64e24e722fcd" returned: 0 in 5.542s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:28 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe66d17-57ff-4aec-8931-d50c5b3d7c67]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:29 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 Jul 23 22:29:29 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:29 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4" returned: 0 in 0.595s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:29 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0718059a-a941-4cf4-a8a3-64e24e722fcd {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:29:29 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Converted 1024.00 MB image at 184.72 MB/s Jul 23 22:29:29 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0718059a-a941-4cf4-a8a3-64e24e722fcd is being set with open permissions: ugo+rw Jul 23 22:29:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0718059a-a941-4cf4-a8a3-64e24e722fcd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:29 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0718059a-a941-4cf4-a8a3-64e24e722fcd Jul 23 22:29:29 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:29 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0718059a-a941-4cf4-a8a3-64e24e722fcd" returned: 0 in 0.280s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-0718059a-a941-4cf4-a8a3-64e24e722fcd" released by "_copy_volume_from_snapshot" :: held 7.447s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7-0718059a-a941-4cf4-a8a3-64e24e722fcd" released by "_create_volume_from_snapshot" :: held 7.507s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.548s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.329s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Creating offline snapshot 2e51837f-e103-4159-823f-a400c53ffa9e of volume 8cfd68d6-657d-41e6-a35f-2b87333af08e {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:29:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a82809-d1d0-421e-bd7d-3a4da7387c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0718059a-a941-4cf4-a8a3-64e24e722fcd', 'volume_size': 2, 'snapshot_id': 'b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e7872c-6103-4c5b-b590-073c6956de7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:29 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[48059d42-c77e-43f8-a5f9-be1dc73233c2]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:29 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Volume volume-0718059a-a941-4cf4-a8a3-64e24e722fcd (0718059a-a941-4cf4-a8a3-64e24e722fcd): created successfully Jul 23 22:29:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e7872c-6103-4c5b-b590-073c6956de7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Flow 'volume_create_manager' (ed3b92d5-e64e-43cd-bcbf-b7bfdc700700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:30 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-d6bf6814-f231-42f1-ab9c-d18541356471 tempest-VolumesSnapshotTestJSON-1747862965 None] Created volume successfully. Jul 23 22:29:30 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e Jul 23 22:29:30 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e" returned: 0 in 0.473s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:30 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:30 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e 1G Jul 23 22:29:30 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:30 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e 1G" returned: 0 in 0.507s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cfd68d6-657d-41e6-a35f-2b87333af08e -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:30 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cfd68d6-657d-41e6-a35f-2b87333af08e -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e Jul 23 22:29:30 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-0718059a-a941-4cf4-a8a3-64e24e722fcd-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-0718059a-a941-4cf4-a8a3-64e24e722fcd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-quobyte-0718059a-a941-4cf4-a8a3-64e24e722fcd" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-0718059a-a941-4cf4-a8a3-64e24e722fcd" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:31 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cfd68d6-657d-41e6-a35f-2b87333af08e -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e" returned: 0 in 0.439s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:31 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e is being set with open permissions: ugo+rw Jul 23 22:29:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:31 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[23733592-0c92-4027-b1bd-91699d3dfea1]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0718059a-a941-4cf4-a8a3-64e24e722fcd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:31 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e Jul 23 22:29:31 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:31 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0718059a-a941-4cf4-a8a3-64e24e722fcd Jul 23 22:29:31 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:31 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e" returned: 0 in 0.311s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:31 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.info Jul 23 22:29:31 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:31 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0718059a-a941-4cf4-a8a3-64e24e722fcd" returned: 0 in 0.468s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0718059a-a941-4cf4-a8a3-64e24e722fcd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:31 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0718059a-a941-4cf4-a8a3-64e24e722fcd Jul 23 22:29:31 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:32 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.info" returned: 0 in 0.313s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:32 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.info is being set with open permissions: ugo+rw Jul 23 22:29:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:32 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.info Jul 23 22:29:32 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:32 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0718059a-a941-4cf4-a8a3-64e24e722fcd" returned: 0 in 0.372s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:32 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-0718059a-a941-4cf4-a8a3-64e24e722fcd" released by "delete_volume" :: held 0.911s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:32 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Created reservations ['84f070d2-8685-433c-85f1-58f096a9ab08', '1f7ab3a0-1c79-4d55-94f5-f56da2aa6f1e', '3acf2c05-977e-4f27-8dc4-70f8007fd6b8', 'fdf21dc0-451e-488d-92f2-7e749fb7ff62'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:32 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.info" returned: 0 in 0.317s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:32 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-5e1f892b-cf7e-49f7-a1ac-98a6be6ec464 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Create snapshot completed successfully Jul 23 22:29:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:32 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:29:32 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:32 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.286s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:32 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:29:32 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Deleted volume successfully. Jul 23 22:29:32 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-89a4736b-d292-4fd5-8052-ae9934c5c823 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-0718059a-a941-4cf4-a8a3-64e24e722fcd-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-quobyte-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-quobyte-b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Deleting offline snapshot b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 of volume 706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] snapshot_file for this snap is: volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d0e652-2a4b-4da7-9fe5-f9faa2f7d66e]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:29:33 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 Jul 23 22:29:33 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Flow 'volume_create_manager' (f5e5114c-cf24-498d-a7c1-d997ebed0eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee00a58-0f8c-4861-a767-e3b1bb996143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee00a58-0f8c-4861-a767-e3b1bb996143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2027630267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a079b096-2cc6-473b-8dd8-96029ee2cdb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524a7e503bf646558379a2192b132912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:34Z,use_quota=True,user_id='360c4a08d1834394be16ce08a96a8364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97dc1a4-bb92-4c46-a3c8-214ef2b5d1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97dc1a4-bb92-4c46-a3c8-214ef2b5d1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc2eb52-caf7-4ce5-aba5-b0aa8c9fb8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc2eb52-caf7-4ce5-aba5-b0aa8c9fb8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a079b096-2cc6-473b-8dd8-96029ee2cdb5', 'volume_name': 'volume-a079b096-2cc6-473b-8dd8-96029ee2cdb5', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbdd8942-951e-4fa8-a368-db1335e56c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbdd8942-951e-4fa8-a368-db1335e56c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4903e99b-40f5-461d-8b1e-d7348e68f385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:33 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume a079b096-2cc6-473b-8dd8-96029ee2cdb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a079b096-2cc6-473b-8dd8-96029ee2cdb5', 'volume_size': 1} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2027630267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a079b096-2cc6-473b-8dd8-96029ee2cdb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524a7e503bf646558379a2192b132912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:34Z,use_quota=True,user_id='360c4a08d1834394be16ce08a96a8364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Creating volume a079b096-2cc6-473b-8dd8-96029ee2cdb5 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:29:33 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:29:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a079b096-2cc6-473b-8dd8-96029ee2cdb5 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:34 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a079b096-2cc6-473b-8dd8-96029ee2cdb5 1073741824 Jul 23 22:29:34 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:34 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7" returned: 0 in 0.709s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[882de44e-0b0b-48c9-ace4-ba09ec839eea]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Flow 'volume_create_manager' (9cc70226-14bb-40ca-8b39-36043fdfd5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c34fd008-bf30-40c5-a860-c4d8227d2eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c34fd008-bf30-40c5-a860-c4d8227d2eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2071692360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524a7e503bf646558379a2192b132912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:34Z,use_quota=True,user_id='360c4a08d1834394be16ce08a96a8364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91df5ce1-03a7-461b-ab4e-06e866b08a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:34 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 Jul 23 22:29:34 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91df5ce1-03a7-461b-ab4e-06e866b08a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a73647-1038-4abf-bdc1-fcc621f1d9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a73647-1038-4abf-bdc1-fcc621f1d9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c', 'volume_name': 'volume-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04b1914-94e7-49f2-9cb5-3a96edf05296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04b1914-94e7-49f2-9cb5-3a96edf05296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81521432-b1aa-4bd9-8343-3e66a9fa9511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:34 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume 35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c', 'volume_size': 1} Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:34 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a079b096-2cc6-473b-8dd8-96029ee2cdb5 1073741824" returned: 0 in 0.912s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a079b096-2cc6-473b-8dd8-96029ee2cdb5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:34 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a079b096-2cc6-473b-8dd8-96029ee2cdb5 Jul 23 22:29:34 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:35 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4" returned: 0 in 0.709s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:35 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 Jul 23 22:29:35 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:29:35 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Flow 'volume_create_manager' (56853c04-fd8d-474e-819d-27c9ef994d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad5cda0-5692-4620-bd03-233276985f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a079b096-2cc6-473b-8dd8-96029ee2cdb5" returned: 0 in 0.548s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.676s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2071692360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524a7e503bf646558379a2192b132912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:34Z,use_quota=True,user_id='360c4a08d1834394be16ce08a96a8364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Creating volume 35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:29:35 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad5cda0-5692-4620-bd03-233276985f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114716311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07a8f90-9f9a-407f-bfde-584e513597c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524a7e503bf646558379a2192b132912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:35Z,use_quota=True,user_id='360c4a08d1834394be16ce08a96a8364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa95d27d-6fa9-4536-9e63-dc9ab92a7f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:35 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c 1073741824 Jul 23 22:29:35 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa95d27d-6fa9-4536-9e63-dc9ab92a7f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e396411e-145b-4c66-a70a-2e2a26783df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e396411e-145b-4c66-a70a-2e2a26783df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b07a8f90-9f9a-407f-bfde-584e513597c4', 'volume_name': 'volume-b07a8f90-9f9a-407f-bfde-584e513597c4', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414179a2-3da6-4cb5-876b-ab1270bfa11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414179a2-3da6-4cb5-876b-ab1270bfa11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1c1769-ac04-4a94-80cd-6b7ea4eb13e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:35 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume b07a8f90-9f9a-407f-bfde-584e513597c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b07a8f90-9f9a-407f-bfde-584e513597c4', 'volume_size': 1} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4903e99b-40f5-461d-8b1e-d7348e68f385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a079b096-2cc6-473b-8dd8-96029ee2cdb5', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61463cdd-2215-4dd4-8185-e2cd74774596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:35 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume volume-a079b096-2cc6-473b-8dd8-96029ee2cdb5 (a079b096-2cc6-473b-8dd8-96029ee2cdb5): created successfully Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61463cdd-2215-4dd4-8185-e2cd74774596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Flow 'volume_create_manager' (f5e5114c-cf24-498d-a7c1-d997ebed0eac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:35 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-3abe2b87-3fb5-4914-9ece-8d8d693f68d0 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Created volume successfully. Jul 23 22:29:35 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7" returned: 0 in 0.676s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:35 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7 Jul 23 22:29:35 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:35 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Flow 'volume_create_manager' (745cc84c-0a95-4a90-9ca6-d31f57a4a2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178ed088-4238-4e7e-840e-391c898bf1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178ed088-4238-4e7e-840e-391c898bf1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2139604669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16436eb2-3473-4874-95a2-8a27ce5f1079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524a7e503bf646558379a2192b132912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:36Z,use_quota=True,user_id='360c4a08d1834394be16ce08a96a8364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f72c17c-438e-48f4-a4ec-ef28cf9b1a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f72c17c-438e-48f4-a4ec-ef28cf9b1a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5f0771-9e32-4391-b283-876f5af22249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5f0771-9e32-4391-b283-876f5af22249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16436eb2-3473-4874-95a2-8a27ce5f1079', 'volume_name': 'volume-16436eb2-3473-4874-95a2-8a27ce5f1079', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5e9a09-6cc9-4fd1-8c0c-ac2df68b299b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5e9a09-6cc9-4fd1-8c0c-ac2df68b299b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff524aa3-d845-4934-976e-96fa9202c951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:36 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume 16436eb2-3473-4874-95a2-8a27ce5f1079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16436eb2-3473-4874-95a2-8a27ce5f1079', 'volume_size': 1} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:36 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4.b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7" returned: 0 in 0.558s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7" released by "_delete_snapshot" :: held 2.833s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4" released by "delete_snapshot" :: held 2.868s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:36 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Created reservations ['e3d0e74f-5e8b-49db-a55a-5470f34a831e', 'e9080d8c-d46b-4259-a9f5-096577550405', 'd11bfc69-cb7c-4c04-ba19-46119b84b348', '76f090c9-2622-466d-8741-6bd40640d2f5'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Flow 'volume_create_manager' (781e9807-4247-47c8-831d-41b145f99f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9f4eb2-cec1-41e4-8a0d-e8027d3de629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c 1073741824" returned: 0 in 1.124s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9f4eb2-cec1-41e4-8a0d-e8027d3de629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-490942728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665e7738-7eeb-47cf-bd22-f041fdea187c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524a7e503bf646558379a2192b132912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:37Z,use_quota=True,user_id='360c4a08d1834394be16ce08a96a8364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee15848d-00f9-471c-bc1d-41473899414b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee15848d-00f9-471c-bc1d-41473899414b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c614622-2ecc-48e5-8233-b8f726aa6d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c614622-2ecc-48e5-8233-b8f726aa6d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '665e7738-7eeb-47cf-bd22-f041fdea187c', 'volume_name': 'volume-665e7738-7eeb-47cf-bd22-f041fdea187c', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f34e16-f466-4219-b4a6-02c49a689634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f34e16-f466-4219-b4a6-02c49a689634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cdae853-236c-4139-8ba5-1125d4f39067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:36 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume 665e7738-7eeb-47cf-bd22-f041fdea187c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-665e7738-7eeb-47cf-bd22-f041fdea187c', 'volume_size': 1} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:36 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c Jul 23 22:29:36 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:36 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Delete snapshot completed successfully. Jul 23 22:29:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e7748501-ab24-4631-a1e9-f48cc1003b4b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-b9234fa7-d9fd-4b14-a3b2-3f9c6f7550d7-delete_snapshot" released by "delete_snapshot" :: held 3.314s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:37 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-quobyte-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c" returned: 0 in 0.366s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.621s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114716311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07a8f90-9f9a-407f-bfde-584e513597c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524a7e503bf646558379a2192b132912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:35Z,use_quota=True,user_id='360c4a08d1834394be16ce08a96a8364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Creating volume b07a8f90-9f9a-407f-bfde-584e513597c4 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:29:37 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b07a8f90-9f9a-407f-bfde-584e513597c4 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4" acquired by "delete_volume" :: waited 0.060s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:37 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b07a8f90-9f9a-407f-bfde-584e513597c4 1073741824 Jul 23 22:29:37 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81521432-b1aa-4bd9-8343-3e66a9fa9511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a0b697-1052-46be-b487-138d7db3b5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5189586c-f2d5-4f5b-92e7-713d3e00730f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:37 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume volume-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c (35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c): created successfully Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a0b697-1052-46be-b487-138d7db3b5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Flow 'volume_create_manager' (9cc70226-14bb-40ca-8b39-36043fdfd5ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:37 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c9c5aa4e-5f7a-4473-abd7-a298117638c5 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Created volume successfully. Jul 23 22:29:37 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 Jul 23 22:29:37 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:38 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4" returned: 0 in 0.693s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:38 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b07a8f90-9f9a-407f-bfde-584e513597c4 1073741824" returned: 0 in 0.821s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:38 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4 Jul 23 22:29:38 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b07a8f90-9f9a-407f-bfde-584e513597c4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:38 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b07a8f90-9f9a-407f-bfde-584e513597c4 Jul 23 22:29:38 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:38 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4" returned: 0 in 0.416s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:38 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b07a8f90-9f9a-407f-bfde-584e513597c4" returned: 0 in 0.352s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4" released by "delete_volume" :: held 1.209s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.249s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2139604669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16436eb2-3473-4874-95a2-8a27ce5f1079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524a7e503bf646558379a2192b132912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:36Z,use_quota=True,user_id='360c4a08d1834394be16ce08a96a8364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Creating volume 16436eb2-3473-4874-95a2-8a27ce5f1079 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:29:38 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-16436eb2-3473-4874-95a2-8a27ce5f1079 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:38 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-16436eb2-3473-4874-95a2-8a27ce5f1079 1073741824 Jul 23 22:29:38 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1c1769-ac04-4a94-80cd-6b7ea4eb13e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b07a8f90-9f9a-407f-bfde-584e513597c4', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3640f1b-a530-409e-92b6-294f14afd663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:38 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume volume-b07a8f90-9f9a-407f-bfde-584e513597c4 (b07a8f90-9f9a-407f-bfde-584e513597c4): created successfully Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3640f1b-a530-409e-92b6-294f14afd663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Flow 'volume_create_manager' (56853c04-fd8d-474e-819d-27c9ef994d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:38 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4eecf4b0-870d-4519-be48-36b84d6589aa tempest-CreateVolumesFromSnapshotTest-1510861767 None] Created volume successfully. Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Created reservations ['94b0adc2-3240-47e2-9fbd-5d41772c8aa9', 'a8df2b82-e614-45de-94b6-e59a38c9bc5f', '7c2558e4-a7f3-479d-a060-7caecc35fcae', '2212c70e-5370-4116-9381-ad5cf7987793'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:38 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:29:38 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:39 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-16436eb2-3473-4874-95a2-8a27ce5f1079 1073741824" returned: 0 in 0.540s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:39 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.354s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:29:39 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Deleted volume successfully. Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-16436eb2-3473-4874-95a2-8a27ce5f1079 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d7ecbef4-40e8-4355-81d6-efbec2d1219f tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-706e5e5c-b1fd-4c1e-91e1-3a9e0f620ae4-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:39 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-16436eb2-3473-4874-95a2-8a27ce5f1079 Jul 23 22:29:39 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:39 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-16436eb2-3473-4874-95a2-8a27ce5f1079" returned: 0 in 0.327s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.636s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-490942728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665e7738-7eeb-47cf-bd22-f041fdea187c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524a7e503bf646558379a2192b132912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:37Z,use_quota=True,user_id='360c4a08d1834394be16ce08a96a8364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Creating volume 665e7738-7eeb-47cf-bd22-f041fdea187c {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:29:39 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-665e7738-7eeb-47cf-bd22-f041fdea187c 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff524aa3-d845-4934-976e-96fa9202c951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16436eb2-3473-4874-95a2-8a27ce5f1079', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:39 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-665e7738-7eeb-47cf-bd22-f041fdea187c 1073741824 Jul 23 22:29:39 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cc8ba7-d1d5-4013-831b-a5a0513b4c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:39 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume volume-16436eb2-3473-4874-95a2-8a27ce5f1079 (16436eb2-3473-4874-95a2-8a27ce5f1079): created successfully Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cc8ba7-d1d5-4013-831b-a5a0513b4c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Flow 'volume_create_manager' (745cc84c-0a95-4a90-9ca6-d31f57a4a2e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:39 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-88fb6b27-d4cc-416e-baba-129adb4c1626 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Created volume successfully. Jul 23 22:29:40 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-665e7738-7eeb-47cf-bd22-f041fdea187c 1073741824" returned: 0 in 0.626s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-665e7738-7eeb-47cf-bd22-f041fdea187c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:40 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-665e7738-7eeb-47cf-bd22-f041fdea187c Jul 23 22:29:40 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:40 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-665e7738-7eeb-47cf-bd22-f041fdea187c" returned: 0 in 0.306s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cdae853-236c-4139-8ba5-1125d4f39067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665e7738-7eeb-47cf-bd22-f041fdea187c', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440d6efc-2261-45b4-9898-202774846d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Flow 'volume_create_manager' (e0e0b510-aff0-4c01-87b1-18cda2b62c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a9ce39-0bef-4e32-bd83-52da222876f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:40 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Volume volume-665e7738-7eeb-47cf-bd22-f041fdea187c (665e7738-7eeb-47cf-bd22-f041fdea187c): created successfully Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440d6efc-2261-45b4-9898-202774846d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Flow 'volume_create_manager' (781e9807-4247-47c8-831d-41b145f99f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a9ce39-0bef-4e32-bd83-52da222876f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-83399982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d89fcd-2dbe-4ac8-893f-ff6202ba9481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265ce24f2d874a7daefb32e7b56dbbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:40Z,use_quota=True,user_id='0d65dc77f8104183af45e1a2f1ca0940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5c06a6-2ed9-4de7-a59f-7e7efec0b747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5c06a6-2ed9-4de7-a59f-7e7efec0b747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ed8ed7-a632-4bf0-a67b-0d83de04dc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ed8ed7-a632-4bf0-a67b-0d83de04dc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d89fcd-2dbe-4ac8-893f-ff6202ba9481', 'volume_name': 'volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d6d035-2dee-4224-8be1-10c054355e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d6d035-2dee-4224-8be1-10c054355e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739c21d3-bbb0-4b66-a3aa-cc5baadb285b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:40 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Volume 44d89fcd-2dbe-4ac8-893f-ff6202ba9481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481', 'volume_size': 1} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-83399982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d89fcd-2dbe-4ac8-893f-ff6202ba9481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265ce24f2d874a7daefb32e7b56dbbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:40Z,use_quota=True,user_id='0d65dc77f8104183af45e1a2f1ca0940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Creating volume 44d89fcd-2dbe-4ac8-893f-ff6202ba9481 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:29:40 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:40 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2b83e8b4-f288-44f5-99c6-057863092eac tempest-CreateVolumesFromSnapshotTest-1510861767 None] Created volume successfully. Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:29:40 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 1073741824 Jul 23 22:29:40 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Flow 'volume_create_manager' (23f8fcd0-df5d-41eb-89ab-888367cd77e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fb6e4a-9e4e-4350-b3a8-f493e591819c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fb6e4a-9e4e-4350-b3a8-f493e591819c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-511260681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525176eb-d538-4709-8886-52261d3bc6af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d754e611f954aa48cac1f76e04f6ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:40Z,use_quota=True,user_id='f4ed3ae31174465c986aac1905fec205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51622cff-0c8d-40fe-8e60-5e873a62cb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51622cff-0c8d-40fe-8e60-5e873a62cb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8a2579-5cad-4e89-b861-8129f5e22d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8a2579-5cad-4e89-b861-8129f5e22d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '525176eb-d538-4709-8886-52261d3bc6af', 'volume_name': 'volume-525176eb-d538-4709-8886-52261d3bc6af', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d55efc-bf7e-47bf-aa40-fa4d376f9b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d55efc-bf7e-47bf-aa40-fa4d376f9b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb38008-004b-4193-ad7a-95390f81442f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:40 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Volume 525176eb-d538-4709-8886-52261d3bc6af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-525176eb-d538-4709-8886-52261d3bc6af', 'volume_size': 1} Jul 23 22:29:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:41 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 1073741824" returned: 0 in 0.524s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:41 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 Jul 23 22:29:41 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "cinder-665e7738-7eeb-47cf-bd22-f041fdea187c-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-665e7738-7eeb-47cf-bd22-f041fdea187c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "cinder-quobyte-665e7738-7eeb-47cf-bd22-f041fdea187c" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-quobyte-665e7738-7eeb-47cf-bd22-f041fdea187c" acquired by "delete_volume" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c18c80-a929-42fc-ab2a-d5ec3c99a8c7]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-665e7738-7eeb-47cf-bd22-f041fdea187c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:41 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481" returned: 0 in 0.352s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.800s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-511260681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525176eb-d538-4709-8886-52261d3bc6af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d754e611f954aa48cac1f76e04f6ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:40Z,use_quota=True,user_id='f4ed3ae31174465c986aac1905fec205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Creating volume 525176eb-d538-4709-8886-52261d3bc6af {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:29:41 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-525176eb-d538-4709-8886-52261d3bc6af 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739c21d3-bbb0-4b66-a3aa-cc5baadb285b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:41 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-525176eb-d538-4709-8886-52261d3bc6af 1073741824 Jul 23 22:29:41 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c73858-3c3a-4fb9-a24e-79088eacaab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:41 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-665e7738-7eeb-47cf-bd22-f041fdea187c Jul 23 22:29:41 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:41 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Volume volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 (44d89fcd-2dbe-4ac8-893f-ff6202ba9481): created successfully Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c73858-3c3a-4fb9-a24e-79088eacaab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Flow 'volume_create_manager' (e0e0b510-aff0-4c01-87b1-18cda2b62c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:41 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ea698ace-8cc3-421a-80d0-05a48868b784 tempest-VolumesSnapshotTestJSON-1747862965 None] Created volume successfully. Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Flow 'volume_create_manager' (dad667ac-6381-43fc-97e4-f73eb50901dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d20ea5d-ff60-466f-b67d-27b04041c484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d20ea5d-ff60-466f-b67d-27b04041c484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2114036808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6ce13938b349ecb3979089e5a04b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:42Z,use_quota=True,user_id='28fca128497942cbac62c8d414c5e526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fa859b-0a69-4717-861f-14210874fe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:41 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fa859b-0a69-4717-861f-14210874fe85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa95b08-6451-4b24-863c-29e27647f285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa95b08-6451-4b24-863c-29e27647f285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e', 'volume_name': 'volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3685ce8-0008-41c2-bbeb-1cf1030dece0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3685ce8-0008-41c2-bbeb-1cf1030dece0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d8bf5b-09db-411f-8bf5-cb35d363fce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:42 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Volume f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e', 'volume_size': 1} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-665e7738-7eeb-47cf-bd22-f041fdea187c" returned: 0 in 0.448s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-665e7738-7eeb-47cf-bd22-f041fdea187c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:42 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-665e7738-7eeb-47cf-bd22-f041fdea187c Jul 23 22:29:42 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:42 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-525176eb-d538-4709-8886-52261d3bc6af 1073741824" returned: 0 in 0.506s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-525176eb-d538-4709-8886-52261d3bc6af {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:42 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-525176eb-d538-4709-8886-52261d3bc6af Jul 23 22:29:42 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:42 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-665e7738-7eeb-47cf-bd22-f041fdea187c" returned: 0 in 0.297s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-quobyte-665e7738-7eeb-47cf-bd22-f041fdea187c" released by "delete_volume" :: held 0.794s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Created reservations ['ac55402b-c36a-4a96-8578-9be68d9e9d45', 'd933a7a5-5297-4563-8d95-9acd3433e1f1', 'c1cf4326-c442-4b1d-90a7-4929991e1911', 'f2ce3ba5-6d9e-4015-9ecc-88532e0c2b46'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:42 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-525176eb-d538-4709-8886-52261d3bc6af" returned: 0 in 0.302s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.507s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2114036808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6ce13938b349ecb3979089e5a04b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:42Z,use_quota=True,user_id='28fca128497942cbac62c8d414c5e526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Creating volume f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:42 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:29:42 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:29:42 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:42 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e 1073741824 Jul 23 22:29:42 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb38008-004b-4193-ad7a-95390f81442f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-525176eb-d538-4709-8886-52261d3bc6af', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101bdbac-bb9e-4adc-a752-babb14e55368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "cinder-16436eb2-3473-4874-95a2-8a27ce5f1079-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:42 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Volume volume-525176eb-d538-4709-8886-52261d3bc6af (525176eb-d538-4709-8886-52261d3bc6af): created successfully Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101bdbac-bb9e-4adc-a752-babb14e55368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Flow 'volume_create_manager' (23f8fcd0-df5d-41eb-89ab-888367cd77e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-16436eb2-3473-4874-95a2-8a27ce5f1079-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:42 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-fc960f7b-4064-433c-8a72-be68664fffb4 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Created volume successfully. Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "cinder-quobyte-16436eb2-3473-4874-95a2-8a27ce5f1079" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-quobyte-16436eb2-3473-4874-95a2-8a27ce5f1079" acquired by "delete_volume" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee99f859-c620-4092-8d95-807e5e9209ba]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-16436eb2-3473-4874-95a2-8a27ce5f1079 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:42 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.315s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:29:42 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Deleted volume successfully. Jul 23 22:29:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-db4a3681-bc68-47a3-8bf1-e48427752925 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-665e7738-7eeb-47cf-bd22-f041fdea187c-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:42 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-16436eb2-3473-4874-95a2-8a27ce5f1079 Jul 23 22:29:42 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:43 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e 1073741824" returned: 0 in 0.507s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:43 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e Jul 23 22:29:43 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:43 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-16436eb2-3473-4874-95a2-8a27ce5f1079" returned: 0 in 0.404s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-16436eb2-3473-4874-95a2-8a27ce5f1079 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:43 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-16436eb2-3473-4874-95a2-8a27ce5f1079 Jul 23 22:29:43 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:43 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" returned: 0 in 0.252s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.685s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d8bf5b-09db-411f-8bf5-cb35d363fce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f028bf6f-8e56-4fef-91b8-3b3cfc4c52ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] Creating offline snapshot 90fd1fde-d90a-4152-b1aa-9b2ac5721415 of volume 44d89fcd-2dbe-4ac8-893f-ff6202ba9481 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:29:43 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Volume volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e (f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e): created successfully Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f028bf6f-8e56-4fef-91b8-3b3cfc4c52ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Flow 'volume_create_manager' (dad667ac-6381-43fc-97e4-f73eb50901dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[da198c80-d9a7-499e-9b1f-1df1ade0b072]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:43 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-0de429ae-0ae0-4506-9b41-f2e1c77606db tempest-VolumesActionsTest-1757549985 None] Created volume successfully. Jul 23 22:29:43 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-16436eb2-3473-4874-95a2-8a27ce5f1079" returned: 0 in 0.268s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-quobyte-16436eb2-3473-4874-95a2-8a27ce5f1079" released by "delete_volume" :: held 0.721s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Created reservations ['a84a9f58-a7ea-4a10-8f86-d59600e6c78b', '185af570-67a5-4a92-a359-d3685535b3d1', 'a376d0ec-2d72-4ff5-9a98-9459c863b204', '62e4d842-29d7-498c-8d25-a8d5ecace2ac'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:43 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 Jul 23 22:29:43 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Acquiring lock "cinder-525176eb-d538-4709-8886-52261d3bc6af-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Lock "cinder-525176eb-d538-4709-8886-52261d3bc6af-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:43 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:29:43 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Acquiring lock "cinder-quobyte-525176eb-d538-4709-8886-52261d3bc6af" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Lock "cinder-quobyte-525176eb-d538-4709-8886-52261d3bc6af" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[67004d5d-b878-4bcc-ba28-20ad213c6d35]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-525176eb-d538-4709-8886-52261d3bc6af {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "cinder-b07a8f90-9f9a-407f-bfde-584e513597c4-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:43 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481" returned: 0 in 0.438s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:43 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-525176eb-d538-4709-8886-52261d3bc6af Jul 23 22:29:43 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-b07a8f90-9f9a-407f-bfde-584e513597c4-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:43 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 1G Jul 23 22:29:43 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "cinder-quobyte-b07a8f90-9f9a-407f-bfde-584e513597c4" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:43 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.354s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:29:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-quobyte-b07a8f90-9f9a-407f-bfde-584e513597c4" acquired by "delete_volume" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:43 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Deleted volume successfully. Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6998f675-245c-4d13-86c3-fcac05ab7222]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b07a8f90-9f9a-407f-bfde-584e513597c4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e0d2b57f-e64c-468f-977f-0f1a905cab21 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-16436eb2-3473-4874-95a2-8a27ce5f1079-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:44 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b07a8f90-9f9a-407f-bfde-584e513597c4 Jul 23 22:29:44 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:44 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-525176eb-d538-4709-8886-52261d3bc6af" returned: 0 in 0.526s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-525176eb-d538-4709-8886-52261d3bc6af {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:44 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-525176eb-d538-4709-8886-52261d3bc6af Jul 23 22:29:44 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:44 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 1G" returned: 0 in 0.570s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:44 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 Jul 23 22:29:44 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:44 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b07a8f90-9f9a-407f-bfde-584e513597c4" returned: 0 in 0.441s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b07a8f90-9f9a-407f-bfde-584e513597c4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:44 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b07a8f90-9f9a-407f-bfde-584e513597c4 Jul 23 22:29:44 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:44 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-525176eb-d538-4709-8886-52261d3bc6af" returned: 0 in 0.301s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Lock "cinder-quobyte-525176eb-d538-4709-8886-52261d3bc6af" released by "delete_volume" :: held 0.887s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Created reservations ['06e9bd06-f3dd-4323-94e0-45ec3999ca70', '290f986f-a987-485c-8979-1a68358d185f', '97001e5f-46ff-4ca7-a3d8-739874b01f83', '84e300cb-3e80-4ef3-9a50-13f0765b344c'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:44 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b07a8f90-9f9a-407f-bfde-584e513597c4" returned: 0 in 0.309s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:44 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:29:44 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-quobyte-b07a8f90-9f9a-407f-bfde-584e513597c4" released by "delete_volume" :: held 0.825s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:44 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415" returned: 0 in 0.395s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:44 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 is being set with open permissions: ugo+rw Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:44 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 Jul 23 22:29:44 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Created reservations ['d87cf5d7-059d-4e5c-9bff-8dfa1cbc0b56', '0a9147f2-64ac-4335-8af9-0465bc0fc060', '8daa61c9-5437-44cd-a1c0-6755c14180f3', '9896ab6b-9a68-411e-af0a-849ff7c1dd4e'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:45 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:29:45 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "cinder-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:45 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.336s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:45 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Deleted volume successfully. Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c4c9a74c-1266-498e-a49c-d92db4f92401 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Lock "cinder-525176eb-d538-4709-8886-52261d3bc6af-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "cinder-quobyte-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:45 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415" returned: 0 in 0.434s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-quobyte-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c" acquired by "delete_volume" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae9b9e6-43f6-4e05-8e0b-a8c72cc1e763]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:45 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.310s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:29:45 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.info Jul 23 22:29:45 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:45 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Deleted volume successfully. Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-21250896-9121-407d-a6d5-358549d8248e tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-b07a8f90-9f9a-407f-bfde-584e513597c4-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:45 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c Jul 23 22:29:45 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:45 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.info" returned: 0 in 0.298s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:45 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.info is being set with open permissions: ugo+rw Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:45 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.info Jul 23 22:29:45 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:45 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c" returned: 0 in 0.452s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:45 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c Jul 23 22:29:45 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:45 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.info" returned: 0 in 0.290s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.596s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:45 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-43eef277-13e8-4ad0-a4be-708f1ff6b3d8 tempest-VolumesSnapshotTestJSON-1747862965 None] Create snapshot completed successfully Jul 23 22:29:46 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c" returned: 0 in 0.370s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-quobyte-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c" released by "delete_volume" :: held 0.876s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Created reservations ['76f5e82e-681a-49f3-b5c4-efb987051ba9', 'd91a4489-869d-4ba9-ae4e-1c14734db67d', 'b878d38a-5163-49b6-8673-f22884ab10d3', '38812df6-b98e-4814-9894-619e6f8e28f0'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:46 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:29:46 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Flow 'volume_create_manager' (009c3cce-71c9-44b4-8699-0b921e524696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3600813a-180e-4226-af23-9364ccf8dc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3600813a-180e-4226-af23-9364ccf8dc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-810085814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6da387-80a6-4d4f-b22b-a0f1831d1cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d754e611f954aa48cac1f76e04f6ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:46Z,use_quota=True,user_id='f4ed3ae31174465c986aac1905fec205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6875817a-b7ff-49e6-842b-1892f8490ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6875817a-b7ff-49e6-842b-1892f8490ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd0da17-696a-465e-8c48-d0c12e0d7a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd0da17-696a-465e-8c48-d0c12e0d7a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b6da387-80a6-4d4f-b22b-a0f1831d1cac', 'volume_name': 'volume-3b6da387-80a6-4d4f-b22b-a0f1831d1cac', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba186dd-87cb-4484-ad5e-0e0582b62aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba186dd-87cb-4484-ad5e-0e0582b62aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e528f9f-d5c0-4f5b-a9c9-07c75011a4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:46 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Volume 3b6da387-80a6-4d4f-b22b-a0f1831d1cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b6da387-80a6-4d4f-b22b-a0f1831d1cac', 'volume_size': 1} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-810085814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6da387-80a6-4d4f-b22b-a0f1831d1cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d754e611f954aa48cac1f76e04f6ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:46Z,use_quota=True,user_id='f4ed3ae31174465c986aac1905fec205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Creating volume 3b6da387-80a6-4d4f-b22b-a0f1831d1cac {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:29:46 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b6da387-80a6-4d4f-b22b-a0f1831d1cac 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:46 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b6da387-80a6-4d4f-b22b-a0f1831d1cac 1073741824 Jul 23 22:29:46 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:46 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.305s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:29:46 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Deleted volume successfully. Jul 23 22:29:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d3e22952-8cf6-4ca4-bc49-f811be0f51ca tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-35d5b0e5-7ecb-4d33-882b-9cc1b4721c2c-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:47 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b6da387-80a6-4d4f-b22b-a0f1831d1cac 1073741824" returned: 0 in 0.596s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b6da387-80a6-4d4f-b22b-a0f1831d1cac {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:47 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b6da387-80a6-4d4f-b22b-a0f1831d1cac Jul 23 22:29:47 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "cinder-a079b096-2cc6-473b-8dd8-96029ee2cdb5-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Flow 'volume_create_manager' (c6f7b948-cab1-4cce-ae5b-a59acca29f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d688d8f-743e-4171-95ce-95949b840bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-a079b096-2cc6-473b-8dd8-96029ee2cdb5-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d688d8f-743e-4171-95ce-95949b840bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1396514681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27c8c082-08fc-4216-bcdc-86ada3711a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265ce24f2d874a7daefb32e7b56dbbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=90fd1fde-d90a-4152-b1aa-9b2ac5721415,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:29:47Z,use_quota=True,user_id='0d65dc77f8104183af45e1a2f1ca0940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed702666-faac-4a6c-a2ac-ae7d47d352c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed702666-faac-4a6c-a2ac-ae7d47d352c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86eba6d6-6c8f-49fe-842d-8bdc29ff9173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86eba6d6-6c8f-49fe-842d-8bdc29ff9173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '27c8c082-08fc-4216-bcdc-86ada3711a2d', 'volume_name': 'volume-27c8c082-08fc-4216-bcdc-86ada3711a2d', 'volume_size': 1, 'snapshot_id': '90fd1fde-d90a-4152-b1aa-9b2ac5721415'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e88466-0c93-40db-88b5-91fd71ff4730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e88466-0c93-40db-88b5-91fd71ff4730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047bc989-855f-4ccb-ab56-9be98b6f19cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:47 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Volume 27c8c082-08fc-4216-bcdc-86ada3711a2d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-27c8c082-08fc-4216-bcdc-86ada3711a2d', 'volume_size': 1, 'snapshot_id': '90fd1fde-d90a-4152-b1aa-9b2ac5721415'} Jul 23 22:29:47 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b6da387-80a6-4d4f-b22b-a0f1831d1cac" returned: 0 in 0.382s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-quobyte-90fd1fde-d90a-4152-b1aa-9b2ac5721415-27c8c082-08fc-4216-bcdc-86ada3711a2d" by "_create_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-90fd1fde-d90a-4152-b1aa-9b2ac5721415-27c8c082-08fc-4216-bcdc-86ada3711a2d" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Creating volume 27c8c082-08fc-4216-bcdc-86ada3711a2d from snapshot 90fd1fde-d90a-4152-b1aa-9b2ac5721415 {{(pid=88308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-quobyte-27c8c082-08fc-4216-bcdc-86ada3711a2d" by "_copy_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e528f9f-d5c0-4f5b-a9c9-07c75011a4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b6da387-80a6-4d4f-b22b-a0f1831d1cac', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3eb834a-1f98-472b-9a51-7fffc11cf115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "cinder-quobyte-a079b096-2cc6-473b-8dd8-96029ee2cdb5" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-27c8c082-08fc-4216-bcdc-86ada3711a2d" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] snapshot: 90fd1fde-d90a-4152-b1aa-9b2ac5721415, volume: 27c8c082-08fc-4216-bcdc-86ada3711a2d, {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 23 22:29:47 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Volume volume-3b6da387-80a6-4d4f-b22b-a0f1831d1cac (3b6da387-80a6-4d4f-b22b-a0f1831d1cac): created successfully Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3eb834a-1f98-472b-9a51-7fffc11cf115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Flow 'volume_create_manager' (009c3cce-71c9-44b4-8699-0b921e524696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-quobyte-a079b096-2cc6-473b-8dd8-96029ee2cdb5" acquired by "delete_volume" :: waited 0.109s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[040f8859-8247-4fdc-8ab6-80754f91743a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a079b096-2cc6-473b-8dd8-96029ee2cdb5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:47 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f7b973f4-cea3-4300-a300-d54cffdfa890 tempest-VolumeQuotasAdminTestJSON-1282028461 None] Created volume successfully. Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[592fc8e5-9bc7-4c8a-8e8b-98220a9f8a43]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:48 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a079b096-2cc6-473b-8dd8-96029ee2cdb5 Jul 23 22:29:48 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 Jul 23 22:29:48 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:48 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:48 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415" returned: 0 in 0.482s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Creating direct copy from snapshot {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 23 22:29:48 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a079b096-2cc6-473b-8dd8-96029ee2cdb5" returned: 0 in 0.535s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a079b096-2cc6-473b-8dd8-96029ee2cdb5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[505d6477-970d-4849-add4-5022fdbeecbe]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:48 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a079b096-2cc6-473b-8dd8-96029ee2cdb5 Jul 23 22:29:48 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:48 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 Jul 23 22:29:48 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:48 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a079b096-2cc6-473b-8dd8-96029ee2cdb5" returned: 0 in 0.352s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-quobyte-a079b096-2cc6-473b-8dd8-96029ee2cdb5" released by "delete_volume" :: held 0.977s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Created reservations ['e23c6d82-559b-4ab3-8745-e798a1631e58', '498c2515-643f-46c9-9847-e6fa0537f617', '3e43b907-3364-4785-a205-2c942708d4a1', 'd12727c5-ab9f-48f2-8c61-2770d3b073d7'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:48 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481" returned: 0 in 0.477s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG cinder.utils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Path /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-27c8c082-08fc-4216-bcdc-86ada3711a2d not found in is_blk_device check {{(pid=88308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-27c8c082-08fc-4216-bcdc-86ada3711a2d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:48 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-27c8c082-08fc-4216-bcdc-86ada3711a2d Jul 23 22:29:48 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:49 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:29:49 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:49 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.462s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:49 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:29:49 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Deleted volume successfully. Jul 23 22:29:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7f597de5-3942-4680-ae90-5a70fafea7a4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-a079b096-2cc6-473b-8dd8-96029ee2cdb5-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:49 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-22d3be47-9b61-45ed-ac1e-5503a10b2378 tempest-VolumeQuotasAdminTestJSON-1042171007 None] Transfer volume completed successfully. Jul 23 22:29:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "cinder-2e51837f-e103-4159-823f-a400c53ffa9e-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-2e51837f-e103-4159-823f-a400c53ffa9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "cinder-quobyte-8cfd68d6-657d-41e6-a35f-2b87333af08e" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-quobyte-8cfd68d6-657d-41e6-a35f-2b87333af08e" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "cinder-quobyte-2e51837f-e103-4159-823f-a400c53ffa9e" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-quobyte-2e51837f-e103-4159-823f-a400c53ffa9e" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Deleting offline snapshot 2e51837f-e103-4159-823f-a400c53ffa9e of volume 8cfd68d6-657d-41e6-a35f-2b87333af08e {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:29:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] snapshot_file for this snap is: volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:29:50 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[af39594d-0f1f-4d7e-9b9a-3f21bcef193f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:50 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e Jul 23 22:29:50 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Acquiring lock "cinder-3b6da387-80a6-4d4f-b22b-a0f1831d1cac-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Lock "cinder-3b6da387-80a6-4d4f-b22b-a0f1831d1cac-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Acquiring lock "cinder-quobyte-3b6da387-80a6-4d4f-b22b-a0f1831d1cac" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:51 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Lock "cinder-quobyte-3b6da387-80a6-4d4f-b22b-a0f1831d1cac" acquired by "delete_volume" :: waited 0.055s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e" returned: 0 in 1.263s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:51 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cfd68d6-657d-41e6-a35f-2b87333af08e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:29:51 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce63b99-9748-4f62-88c3-cbbb5ab47868]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b6da387-80a6-4d4f-b22b-a0f1831d1cac {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:51 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e418486e-ec6b-4a5e-8eee-a36413f38753]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:51 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b6da387-80a6-4d4f-b22b-a0f1831d1cac Jul 23 22:29:51 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:52 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e Jul 23 22:29:52 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:53 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b6da387-80a6-4d4f-b22b-a0f1831d1cac" returned: 0 in 1.573s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b6da387-80a6-4d4f-b22b-a0f1831d1cac {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:53 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b6da387-80a6-4d4f-b22b-a0f1831d1cac Jul 23 22:29:53 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:53 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e" returned: 0 in 1.944s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:53 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e Jul 23 22:29:53 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:53 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b6da387-80a6-4d4f-b22b-a0f1831d1cac" returned: 0 in 0.916s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Lock "cinder-quobyte-3b6da387-80a6-4d4f-b22b-a0f1831d1cac" released by "delete_volume" :: held 2.716s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:54 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=183,cinder:INSERT=56,cinder:UPDATE=207,cinder:DELETE=13 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:29:54 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=171,cinder:INSERT=49,cinder:UPDATE=213,cinder:DELETE=23 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:29:54 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Created reservations ['31ee70a8-4d5d-4794-94f2-c62e6a9630f9', 'c3471653-2162-4676-a6fc-3984ac471966', 'fdf0ef65-d642-45c0-86ec-81badfe777d1', 'b2d8d37e-59f6-430a-9c2e-0ca3389a61af'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:54 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:29:54 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:54 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e" returned: 0 in 1.302s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:54 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e Jul 23 22:29:54 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:55 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.800s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:55 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:29:55 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Deleted volume successfully. Jul 23 22:29:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-50663395-3f9f-4c31-a618-b41390f78068 tempest-VolumeQuotasAdminTestJSON-814687099 None] Lock "cinder-3b6da387-80a6-4d4f-b22b-a0f1831d1cac-delete_volume" released by "delete_volume" :: held 4.317s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:55 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e.2e51837f-e103-4159-823f-a400c53ffa9e" returned: 0 in 1.104s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-quobyte-2e51837f-e103-4159-823f-a400c53ffa9e" released by "_delete_snapshot" :: held 6.115s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-quobyte-8cfd68d6-657d-41e6-a35f-2b87333af08e" released by "delete_snapshot" :: held 6.222s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:56 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Created reservations ['6d21619e-a880-4424-a225-6660d3d4d256', '1591fa62-f653-4aca-8462-731dacda56cf', 'ed84126b-c2fd-4c6d-b4f1-cad3ef629ea2', '890ff47f-184b-4cfb-8e6c-dbd186522140'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:56 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Delete snapshot completed successfully. Jul 23 22:29:56 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-22dfd898-d5e0-4e9c-939c-bb5dd2ba5a73 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-2e51837f-e103-4159-823f-a400c53ffa9e-delete_snapshot" released by "delete_snapshot" :: held 6.558s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-27c8c082-08fc-4216-bcdc-86ada3711a2d" returned: 0 in 7.522s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:56 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61371fc-cfc7-410c-8171-d9143053e8e4]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:56 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 Jul 23 22:29:56 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "cinder-8cfd68d6-657d-41e6-a35f-2b87333af08e-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-8cfd68d6-657d-41e6-a35f-2b87333af08e-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "cinder-quobyte-8cfd68d6-657d-41e6-a35f-2b87333af08e" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-quobyte-8cfd68d6-657d-41e6-a35f-2b87333af08e" acquired by "delete_volume" :: waited 0.037s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fc349f-a390-48a9-b97d-d1f9574c35be]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:57 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e Jul 23 22:29:57 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:57 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481" returned: 0 in 0.845s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481, size 1024.00 MB, duration 7.52 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-27c8c082-08fc-4216-bcdc-86ada3711a2d {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:29:57 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Converted 1024.00 MB image at 136.11 MB/s Jul 23 22:29:57 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-27c8c082-08fc-4216-bcdc-86ada3711a2d is being set with open permissions: ugo+rw Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-27c8c082-08fc-4216-bcdc-86ada3711a2d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:57 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-27c8c082-08fc-4216-bcdc-86ada3711a2d Jul 23 22:29:57 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:57 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:57 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-27c8c082-08fc-4216-bcdc-86ada3711a2d" returned: 0 in 0.300s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e" returned: 0 in 0.526s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-27c8c082-08fc-4216-bcdc-86ada3711a2d" released by "_copy_volume_from_snapshot" :: held 9.907s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:57 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e Jul 23 22:29:57 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-90fd1fde-d90a-4152-b1aa-9b2ac5721415-27c8c082-08fc-4216-bcdc-86ada3711a2d" released by "_create_volume_from_snapshot" :: held 9.985s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047bc989-855f-4ccb-ab56-9be98b6f19cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27c8c082-08fc-4216-bcdc-86ada3711a2d', 'volume_size': 1, 'snapshot_id': '90fd1fde-d90a-4152-b1aa-9b2ac5721415'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7f4bf0-fd21-4ffe-ba36-e7d5938c7ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:29:57 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Volume volume-27c8c082-08fc-4216-bcdc-86ada3711a2d (27c8c082-08fc-4216-bcdc-86ada3711a2d): created successfully Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7f4bf0-fd21-4ffe-ba36-e7d5938c7ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Flow 'volume_create_manager' (c6f7b948-cab1-4cce-ae5b-a59acca29f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:29:57 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e0f961fc-deaa-43e0-b3af-2ae66e010a6e tempest-VolumesSnapshotTestJSON-1747862965 None] Created volume successfully. Jul 23 22:29:57 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8cfd68d6-657d-41e6-a35f-2b87333af08e" returned: 0 in 0.338s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-quobyte-8cfd68d6-657d-41e6-a35f-2b87333af08e" released by "delete_volume" :: held 0.982s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:58 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Created reservations ['ceb50b1b-6339-4249-b9ae-de2576c1da64', '7a219c4e-3015-4b40-b6a0-b9c4aed761a2', '3460dce0-4ac9-4b87-9ac3-1b83e4fd5f89', 'c86b5062-c98a-4b44-8ff6-131d85515947'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:29:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:29:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:29:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:29:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:29:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:29:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:58 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:29:58 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:58 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.296s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:58 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:29:58 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Deleted volume successfully. Jul 23 22:29:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d0946533-e918-4c3a-9a8b-f314a088e1d4 tempest-CreateVolumesFromSnapshotTest-1510861767 None] Lock "cinder-8cfd68d6-657d-41e6-a35f-2b87333af08e-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3b3774e8-a54a-4016-9c42-cbe72d422da4 tempest-VolumesActionsTest-1757549985 None] Acquiring lock "cinder-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" by "attach_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3b3774e8-a54a-4016-9c42-cbe72d422da4 tempest-VolumesActionsTest-1757549985 None] Lock "cinder-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" acquired by "attach_volume" :: waited 0.028s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:58 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-3b3774e8-a54a-4016-9c42-cbe72d422da4 tempest-VolumesActionsTest-1757549985 None] Attaching volume f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e to instance a986989f-86c8-43ff-b93b-6a1cd895040e at mountpoint /dev/vdb on host None. Jul 23 22:29:58 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-3b3774e8-a54a-4016-9c42-cbe72d422da4 tempest-VolumesActionsTest-1757549985 None] Attach volume completed successfully. Jul 23 22:29:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3b3774e8-a54a-4016-9c42-cbe72d422da4 tempest-VolumesActionsTest-1757549985 None] Lock "cinder-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" released by "attach_volume" :: held 0.170s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-27c8c082-08fc-4216-bcdc-86ada3711a2d-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-27c8c082-08fc-4216-bcdc-86ada3711a2d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a1ac534b-a6c7-4794-9b19-e83165901abf tempest-VolumesActionsTest-1757549985 None] Acquiring lock "cinder-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e-detach_volume" by "detach_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-quobyte-27c8c082-08fc-4216-bcdc-86ada3711a2d" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:29:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a1ac534b-a6c7-4794-9b19-e83165901abf tempest-VolumesActionsTest-1757549985 None] Lock "cinder-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:59 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a1ac534b-a6c7-4794-9b19-e83165901abf tempest-VolumesActionsTest-1757549985 None] Detaching volume f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e from instance a986989f-86c8-43ff-b93b-6a1cd895040e. Jul 23 22:29:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-27c8c082-08fc-4216-bcdc-86ada3711a2d" acquired by "delete_volume" :: waited 0.034s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:29:59 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[62da6fd1-3baa-4766-b1ca-0cd5e7525c6b]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:29:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-27c8c082-08fc-4216-bcdc-86ada3711a2d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:59 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a1ac534b-a6c7-4794-9b19-e83165901abf tempest-VolumesActionsTest-1757549985 None] Detach volume completed successfully. Jul 23 22:29:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a1ac534b-a6c7-4794-9b19-e83165901abf tempest-VolumesActionsTest-1757549985 None] Lock "cinder-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e-detach_volume" released by "detach_volume" :: held 0.250s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:29:59 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-27c8c082-08fc-4216-bcdc-86ada3711a2d Jul 23 22:29:59 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:29:59 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Jul 23 22:29:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-27c8c082-08fc-4216-bcdc-86ada3711a2d" returned: 0 in 0.638s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:29:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-27c8c082-08fc-4216-bcdc-86ada3711a2d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:29:59 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-27c8c082-08fc-4216-bcdc-86ada3711a2d Jul 23 22:29:59 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:00 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-27c8c082-08fc-4216-bcdc-86ada3711a2d" returned: 0 in 0.330s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-27c8c082-08fc-4216-bcdc-86ada3711a2d" released by "delete_volume" :: held 1.070s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:00 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Created reservations ['58f58070-e3d1-4b99-bfed-91e894a83f46', 'e1519595-b8a0-4dc0-b175-53c12e76bace', '1a4ed49d-7fea-4e0a-a22b-44e3495793ce', '5a63d775-a9d0-43d7-a3e3-68c6c4821cf5'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:30:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:00 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:30:00 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:00 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.287s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:00 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:30:00 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Deleted volume successfully. Jul 23 22:30:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-53532d6f-0060-4610-b94d-b7b7dbcf6d1b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-27c8c082-08fc-4216-bcdc-86ada3711a2d-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:01 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-90fd1fde-d90a-4152-b1aa-9b2ac5721415-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:01 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-90fd1fde-d90a-4152-b1aa-9b2ac5721415-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:01 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-quobyte-44d89fcd-2dbe-4ac8-893f-ff6202ba9481" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:01 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-44d89fcd-2dbe-4ac8-893f-ff6202ba9481" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:01 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-quobyte-90fd1fde-d90a-4152-b1aa-9b2ac5721415" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:01 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-90fd1fde-d90a-4152-b1aa-9b2ac5721415" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:01 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Deleting offline snapshot 90fd1fde-d90a-4152-b1aa-9b2ac5721415 of volume 44d89fcd-2dbe-4ac8-893f-ff6202ba9481 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:30:01 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] snapshot_file for this snap is: volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:30:01 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e03c96-5693-4b94-8efb-b42580f67284]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:30:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:01 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 Jul 23 22:30:01 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:02 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415" returned: 0 in 0.580s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:02 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:30:02 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[36488549-0fdf-4a45-84b9-10dc9bf44d72]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:30:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:02 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 Jul 23 22:30:02 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:02 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481" returned: 0 in 0.548s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:02 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 Jul 23 22:30:02 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:03 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415" returned: 0 in 0.445s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:03 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415 Jul 23 22:30:03 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:03 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481.90fd1fde-d90a-4152-b1aa-9b2ac5721415" returned: 0 in 0.340s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:03 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-90fd1fde-d90a-4152-b1aa-9b2ac5721415" released by "_delete_snapshot" :: held 2.107s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:03 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-44d89fcd-2dbe-4ac8-893f-ff6202ba9481" released by "delete_snapshot" :: held 2.139s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:03 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Created reservations ['2135660a-ca80-48b3-8702-7d476109c069', 'c04d8842-368a-4127-89bc-d4637d5428e6', '1d22c097-0290-4674-8023-04f68de46415', '34418ba3-5ac0-4e97-9651-201f61c107e2'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:30:03 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Delete snapshot completed successfully. Jul 23 22:30:03 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-56227b7f-b81a-4430-953f-8c7c66e0289c tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-90fd1fde-d90a-4152-b1aa-9b2ac5721415-delete_snapshot" released by "delete_snapshot" :: held 2.339s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:04 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-44d89fcd-2dbe-4ac8-893f-ff6202ba9481-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:04 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-44d89fcd-2dbe-4ac8-893f-ff6202ba9481-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:04 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-quobyte-44d89fcd-2dbe-4ac8-893f-ff6202ba9481" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:04 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-44d89fcd-2dbe-4ac8-893f-ff6202ba9481" acquired by "delete_volume" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:04 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd13f257-34d5-476f-806a-f5d8bc22a421]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:30:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:05 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 Jul 23 22:30:05 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:05 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481" returned: 0 in 0.566s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:05 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481 Jul 23 22:30:05 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:05 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-44d89fcd-2dbe-4ac8-893f-ff6202ba9481" returned: 0 in 0.355s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:05 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-44d89fcd-2dbe-4ac8-893f-ff6202ba9481" released by "delete_volume" :: held 1.009s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:05 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Created reservations ['9a1dd4ea-04b6-43b2-b2fa-bce951f8a2e2', 'f8f73f94-34bc-4d64-8f09-7f53de1df7c3', 'b8c7aabc-2125-4098-aec0-3d9a06738db9', '0ef3842e-9adb-4f14-aff0-804bf9b020cd'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:30:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:05 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:05 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:06 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:30:06 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:06 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.392s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:06 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:30:06 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Deleted volume successfully. Jul 23 22:30:06 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-91d73a93-b071-4abc-98ba-67f9bf6fe11b tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-44d89fcd-2dbe-4ac8-893f-ff6202ba9481-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-8388d50a-4913-4f11-8109-e9a660d59743-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-8388d50a-4913-4f11-8109-e9a660d59743-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "cinder-quobyte-8388d50a-4913-4f11-8109-e9a660d59743" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-8388d50a-4913-4f11-8109-e9a660d59743" acquired by "delete_volume" :: waited 0.049s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:07 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c770bcfe-a58a-4060-ae69-25770bdfb281]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:30:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:07 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743 Jul 23 22:30:07 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:07 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743" returned: 0 in 0.442s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:07 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743 Jul 23 22:30:07 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:08 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8388d50a-4913-4f11-8109-e9a660d59743" returned: 0 in 0.293s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:08 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-quobyte-8388d50a-4913-4f11-8109-e9a660d59743" released by "delete_volume" :: held 0.835s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:08 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Created reservations ['b27e2314-5f8a-42f7-949d-2978e034938a', '7963adb6-834b-4e5a-b5b6-cfb1025ed909', 'e457b8d8-16f1-48f3-871e-99b827c5bf2b', 'dde72ddc-b018-484f-ae75-3e5745fba611'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:30:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:08 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:08 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:08 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:30:08 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:08 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.301s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:08 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:30:08 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Deleted volume successfully. Jul 23 22:30:08 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f1cbf7e2-a564-46a7-9ea8-c1c629abaef7 tempest-VolumesSnapshotTestJSON-1747862965 None] Lock "cinder-8388d50a-4913-4f11-8109-e9a660d59743-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Flow 'volume_create_manager' (5ebcd9cb-b0d7-403a-b762-90411ca4b91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059522ae-ffd7-4fee-8372-271e8baae022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059522ae-ffd7-4fee-8372-271e8baae022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-304532728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7457bb-f6ce-4c97-b27a-edb85ec5f926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc693816173d4d34afb5049d085056cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:14Z,use_quota=True,user_id='695c4ac371aa4ad8989c532e0d4847a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726d6bbd-d531-4223-ad3e-864be2816f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726d6bbd-d531-4223-ad3e-864be2816f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e919addc-577b-4d97-b5c3-4ff7b7daec62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e919addc-577b-4d97-b5c3-4ff7b7daec62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d7457bb-f6ce-4c97-b27a-edb85ec5f926', 'volume_name': 'volume-2d7457bb-f6ce-4c97-b27a-edb85ec5f926', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94be30c3-c591-43aa-bbea-bd5371c11870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94be30c3-c591-43aa-bbea-bd5371c11870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d530f71-9592-47dd-b5ac-77dd1a3b97d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:13 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Volume 2d7457bb-f6ce-4c97-b27a-edb85ec5f926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d7457bb-f6ce-4c97-b27a-edb85ec5f926', 'volume_size': 1} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-304532728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7457bb-f6ce-4c97-b27a-edb85ec5f926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc693816173d4d34afb5049d085056cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:14Z,use_quota=True,user_id='695c4ac371aa4ad8989c532e0d4847a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Creating volume 2d7457bb-f6ce-4c97-b27a-edb85ec5f926 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:30:13 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:30:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2d7457bb-f6ce-4c97-b27a-edb85ec5f926 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:14 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2d7457bb-f6ce-4c97-b27a-edb85ec5f926 1073741824 Jul 23 22:30:14 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:14 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2d7457bb-f6ce-4c97-b27a-edb85ec5f926 1073741824" returned: 0 in 0.615s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2d7457bb-f6ce-4c97-b27a-edb85ec5f926 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:14 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2d7457bb-f6ce-4c97-b27a-edb85ec5f926 Jul 23 22:30:14 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:15 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2d7457bb-f6ce-4c97-b27a-edb85ec5f926" returned: 0 in 0.353s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:30:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d530f71-9592-47dd-b5ac-77dd1a3b97d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d7457bb-f6ce-4c97-b27a-edb85ec5f926', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0df336-c8b8-4d09-a0dc-7d92f9a5d2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:15 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Volume volume-2d7457bb-f6ce-4c97-b27a-edb85ec5f926 (2d7457bb-f6ce-4c97-b27a-edb85ec5f926): created successfully Jul 23 22:30:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0df336-c8b8-4d09-a0dc-7d92f9a5d2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Flow 'volume_create_manager' (5ebcd9cb-b0d7-403a-b762-90411ca4b91d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:15 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-1a1d2b5f-bcf1-4c2a-b95e-4ccf0f747854 tempest-ProjectReaderTests-562364255 None] Created volume successfully. Jul 23 22:30:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Acquiring lock "cinder-2d7457bb-f6ce-4c97-b27a-edb85ec5f926-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Lock "cinder-2d7457bb-f6ce-4c97-b27a-edb85ec5f926-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Acquiring lock "cinder-quobyte-2d7457bb-f6ce-4c97-b27a-edb85ec5f926" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Lock "cinder-quobyte-2d7457bb-f6ce-4c97-b27a-edb85ec5f926" acquired by "delete_volume" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:16 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf35b4e0-0a39-4c1b-b976-d3fbfb39f5ef]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:30:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2d7457bb-f6ce-4c97-b27a-edb85ec5f926 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:16 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2d7457bb-f6ce-4c97-b27a-edb85ec5f926 Jul 23 22:30:16 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:17 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2d7457bb-f6ce-4c97-b27a-edb85ec5f926" returned: 0 in 0.660s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2d7457bb-f6ce-4c97-b27a-edb85ec5f926 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-cc871c08-f580-4171-9f46-477c4e03afe6 tempest-VolumesActionsTest-1757549985 None] Acquiring lock "cinder-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" by "attach_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-cc871c08-f580-4171-9f46-477c4e03afe6 tempest-VolumesActionsTest-1757549985 None] Lock "cinder-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" acquired by "attach_volume" :: waited 0.025s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:17 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2d7457bb-f6ce-4c97-b27a-edb85ec5f926 Jul 23 22:30:17 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:17 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-cc871c08-f580-4171-9f46-477c4e03afe6 tempest-VolumesActionsTest-1757549985 None] Attaching volume f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e to instance 2c5a2f08-8432-41a6-a536-58a9cf083961 at mountpoint /dev/vdb on host None. Jul 23 22:30:17 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-cc871c08-f580-4171-9f46-477c4e03afe6 tempest-VolumesActionsTest-1757549985 None] Attach volume completed successfully. Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-cc871c08-f580-4171-9f46-477c4e03afe6 tempest-VolumesActionsTest-1757549985 None] Lock "cinder-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" released by "attach_volume" :: held 0.183s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:17 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2d7457bb-f6ce-4c97-b27a-edb85ec5f926" returned: 0 in 0.431s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Lock "cinder-quobyte-2d7457bb-f6ce-4c97-b27a-edb85ec5f926" released by "delete_volume" :: held 1.162s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Created reservations ['9ab81700-f003-4dd1-8200-901724108157', '83f4d32a-03ec-4745-8508-a3b3a1be361e', 'fdd4347a-345f-4def-83fa-0ee1d3e25fa5', 'd7b7292e-7544-4497-a826-ef1f7370a90c'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4df498a4-fe46-44bb-8c43-7f01df2c335c tempest-VolumesActionsTest-1757549985 None] Acquiring lock "cinder-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e-detach_volume" by "detach_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4df498a4-fe46-44bb-8c43-7f01df2c335c tempest-VolumesActionsTest-1757549985 None] Lock "cinder-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:17 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4df498a4-fe46-44bb-8c43-7f01df2c335c tempest-VolumesActionsTest-1757549985 None] Detaching volume f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e from instance 2c5a2f08-8432-41a6-a536-58a9cf083961. Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:17 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:30:17 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:17 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4df498a4-fe46-44bb-8c43-7f01df2c335c tempest-VolumesActionsTest-1757549985 None] Detach volume completed successfully. Jul 23 22:30:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4df498a4-fe46-44bb-8c43-7f01df2c335c tempest-VolumesActionsTest-1757549985 None] Lock "cinder-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e-detach_volume" released by "detach_volume" :: held 0.166s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:18 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.418s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:18 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:30:18 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Deleted volume successfully. Jul 23 22:30:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-26d920ce-e195-44e9-8bf7-2bb6111cbc5d tempest-ProjectReaderTests-562364255 None] Lock "cinder-2d7457bb-f6ce-4c97-b27a-edb85ec5f926-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Flow 'volume_create_manager' (4f475e68-af67-4496-9df2-6281d40d92e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789aabc0-924f-4b7b-bb8f-8bd62d92a774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789aabc0-924f-4b7b-bb8f-8bd62d92a774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-998031949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d28e975-04c7-4ffe-a07b-34fce7114874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc693816173d4d34afb5049d085056cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:19Z,use_quota=True,user_id='695c4ac371aa4ad8989c532e0d4847a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47f71b7-fcee-4039-833b-4b31d4794e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47f71b7-fcee-4039-833b-4b31d4794e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a23c5ca-bd44-4a4f-9abd-d27ab3eb8cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a23c5ca-bd44-4a4f-9abd-d27ab3eb8cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d28e975-04c7-4ffe-a07b-34fce7114874', 'volume_name': 'volume-8d28e975-04c7-4ffe-a07b-34fce7114874', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1242d2d-feaa-460a-bd8d-e82a428821df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1242d2d-feaa-460a-bd8d-e82a428821df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02f1bce-ba5d-48c7-9ef0-f057aceddec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:19 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Volume 8d28e975-04c7-4ffe-a07b-34fce7114874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d28e975-04c7-4ffe-a07b-34fce7114874', 'volume_size': 1} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-998031949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d28e975-04c7-4ffe-a07b-34fce7114874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc693816173d4d34afb5049d085056cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:19Z,use_quota=True,user_id='695c4ac371aa4ad8989c532e0d4847a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Creating volume 8d28e975-04c7-4ffe-a07b-34fce7114874 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:30:19 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d28e975-04c7-4ffe-a07b-34fce7114874 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:19 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d28e975-04c7-4ffe-a07b-34fce7114874 1073741824 Jul 23 22:30:19 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Flow 'volume_create_manager' (afc7949c-242b-47d6-bffc-a80214b4a025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7803fd39-632d-41bb-b6ee-4d4db20f2e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7803fd39-632d-41bb-b6ee-4d4db20f2e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1495500791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='67084bfa153c46e5a37ac7d41af70dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:20Z,use_quota=True,user_id='13626a8f3ae043e7aaaa365f543a2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8e3314-8dce-4a99-bd3e-475f58432b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8e3314-8dce-4a99-bd3e-475f58432b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3263df-4528-4a72-bd70-0b0174072863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3263df-4528-4a72-bd70-0b0174072863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b', 'volume_name': 'volume-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6a6687-bac0-413e-80e0-dd9525cdc16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6a6687-bac0-413e-80e0-dd9525cdc16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e658d9-b6e7-47a1-9998-f5a1cb2a7515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:20 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:20 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Volume 19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b', 'volume_size': 1} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d28e975-04c7-4ffe-a07b-34fce7114874 1073741824" returned: 0 in 0.760s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d28e975-04c7-4ffe-a07b-34fce7114874 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:20 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d28e975-04c7-4ffe-a07b-34fce7114874 Jul 23 22:30:20 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:20 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d28e975-04c7-4ffe-a07b-34fce7114874" returned: 0 in 0.307s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.397s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1495500791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='67084bfa153c46e5a37ac7d41af70dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:20Z,use_quota=True,user_id='13626a8f3ae043e7aaaa365f543a2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Creating volume 19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:30:20 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:20 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b 1073741824 Jul 23 22:30:20 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02f1bce-ba5d-48c7-9ef0-f057aceddec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d28e975-04c7-4ffe-a07b-34fce7114874', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f2f0dc-821f-480a-828a-d003f05988f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:20 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Volume volume-8d28e975-04c7-4ffe-a07b-34fce7114874 (8d28e975-04c7-4ffe-a07b-34fce7114874): created successfully Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f2f0dc-821f-480a-828a-d003f05988f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Flow 'volume_create_manager' (4f475e68-af67-4496-9df2-6281d40d92e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:20 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-1ee48745-7cca-42d5-9009-b8a4bee4019b tempest-ProjectReaderTests-562364255 None] Created volume successfully. Jul 23 22:30:21 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b 1073741824" returned: 0 in 0.495s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:21 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b Jul 23 22:30:21 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:21 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b" returned: 0 in 0.337s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:30:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e658d9-b6e7-47a1-9998-f5a1cb2a7515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bd3430-8d39-466d-8831-21c0bf541b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:21 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Volume volume-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b (19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b): created successfully Jul 23 22:30:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bd3430-8d39-466d-8831-21c0bf541b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Flow 'volume_create_manager' (afc7949c-242b-47d6-bffc-a80214b4a025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Acquiring lock "cinder-8d28e975-04c7-4ffe-a07b-34fce7114874-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:21 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ad7ea0f2-03fc-4ff7-810f-dd44833cb1de tempest-VolumesGetTest-501658789 None] Created volume successfully. Jul 23 22:30:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Lock "cinder-8d28e975-04c7-4ffe-a07b-34fce7114874-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Acquiring lock "cinder-quobyte-8d28e975-04c7-4ffe-a07b-34fce7114874" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Lock "cinder-quobyte-8d28e975-04c7-4ffe-a07b-34fce7114874" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:21 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d86fad1-6f3c-4334-8748-d13a226c0fdc]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:30:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d28e975-04c7-4ffe-a07b-34fce7114874 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:21 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d28e975-04c7-4ffe-a07b-34fce7114874 Jul 23 22:30:21 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:22 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d28e975-04c7-4ffe-a07b-34fce7114874" returned: 0 in 0.492s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d28e975-04c7-4ffe-a07b-34fce7114874 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:22 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d28e975-04c7-4ffe-a07b-34fce7114874 Jul 23 22:30:22 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:22 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d28e975-04c7-4ffe-a07b-34fce7114874" returned: 0 in 0.305s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Lock "cinder-quobyte-8d28e975-04c7-4ffe-a07b-34fce7114874" released by "delete_volume" :: held 0.854s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Created reservations ['42a7a8ea-30f0-4e4e-b5c3-5f431911c0a7', '6f7ea9f0-e151-4f43-8bc3-51d2dadad15a', '7de9de76-e7ce-466d-8942-38b2f4fe0e0a', '37a96115-9bdb-4f90-8701-13c1b9024dd9'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:22 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:30:22 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Flow 'volume_create_manager' (cda896b8-d678-41e5-9437-d9cf767628b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1402423b-c4a6-4c05-9228-effba58fecf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1402423b-c4a6-4c05-9228-effba58fecf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1943076932',display_name='tempest-VolumesGetTest-Volume-1509275344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d695b1-fd92-4191-ae8f-019296cc5cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67084bfa153c46e5a37ac7d41af70dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:23Z,use_quota=True,user_id='13626a8f3ae043e7aaaa365f543a2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62013135-854e-4a23-9887-9eef48e9ec35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62013135-854e-4a23-9887-9eef48e9ec35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59955138-0435-4eb6-aba3-e1c65c943ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59955138-0435-4eb6-aba3-e1c65c943ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d695b1-fd92-4191-ae8f-019296cc5cb9', 'volume_name': 'volume-21d695b1-fd92-4191-ae8f-019296cc5cb9', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584b9c21-1498-4ede-86e3-90b152923c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584b9c21-1498-4ede-86e3-90b152923c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c92b024-3aab-4509-b076-301e53472724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:22 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Volume 21d695b1-fd92-4191-ae8f-019296cc5cb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d695b1-fd92-4191-ae8f-019296cc5cb9', 'volume_size': 1} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1943076932',display_name='tempest-VolumesGetTest-Volume-1509275344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d695b1-fd92-4191-ae8f-019296cc5cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67084bfa153c46e5a37ac7d41af70dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:23Z,use_quota=True,user_id='13626a8f3ae043e7aaaa365f543a2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Creating volume 21d695b1-fd92-4191-ae8f-019296cc5cb9 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:30:22 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:30:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-21d695b1-fd92-4191-ae8f-019296cc5cb9 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:23 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-21d695b1-fd92-4191-ae8f-019296cc5cb9 1073741824 Jul 23 22:30:23 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:23 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.431s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:30:23 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Deleted volume successfully. Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3f9dbd9c-1b56-475e-9e75-4924dce5413e tempest-ProjectReaderTests-562364255 None] Lock "cinder-8d28e975-04c7-4ffe-a07b-34fce7114874-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9c37dd21-d553-4d6e-bef2-7c9146a01267 tempest-VolumesActionsTest-1757549985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Flow 'volume_create_manager' (25ba057d-f831-4f7b-8852-cfcfc1094608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81852362-ef8d-482e-88c9-1bd867e736e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81852362-ef8d-482e-88c9-1bd867e736e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-510999197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e006ec-a714-45c6-b7ee-29e75ba60b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc693816173d4d34afb5049d085056cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:23Z,use_quota=True,user_id='695c4ac371aa4ad8989c532e0d4847a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69ebbb5-dac1-497c-99db-d72f308e73b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69ebbb5-dac1-497c-99db-d72f308e73b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fead600-51c1-43f3-9ad9-c5ed7cc25674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fead600-51c1-43f3-9ad9-c5ed7cc25674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e006ec-a714-45c6-b7ee-29e75ba60b56', 'volume_name': 'volume-91e006ec-a714-45c6-b7ee-29e75ba60b56', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f00198a-5cf6-447a-840e-40b3c6844a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f00198a-5cf6-447a-840e-40b3c6844a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958c3818-14be-4a38-85b6-eb68cf2bed23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:23 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Volume 91e006ec-a714-45c6-b7ee-29e75ba60b56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e006ec-a714-45c6-b7ee-29e75ba60b56', 'volume_size': 1} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:23 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-21d695b1-fd92-4191-ae8f-019296cc5cb9 1073741824" returned: 0 in 0.713s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-21d695b1-fd92-4191-ae8f-019296cc5cb9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:23 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-21d695b1-fd92-4191-ae8f-019296cc5cb9 Jul 23 22:30:23 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:23 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-21d695b1-fd92-4191-ae8f-019296cc5cb9" returned: 0 in 0.255s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9c37dd21-d553-4d6e-bef2-7c9146a01267 tempest-VolumesActionsTest-1757549985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.625s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c92b024-3aab-4509-b076-301e53472724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d695b1-fd92-4191-ae8f-019296cc5cb9', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8df58fc-48ed-4510-835b-5613a169df09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4ac431-f453-4632-beb4-24d58b751c74]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:30:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9c37dd21-d553-4d6e-bef2-7c9146a01267 tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:24 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Volume volume-21d695b1-fd92-4191-ae8f-019296cc5cb9 (21d695b1-fd92-4191-ae8f-019296cc5cb9): created successfully Jul 23 22:30:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8df58fc-48ed-4510-835b-5613a169df09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Flow 'volume_create_manager' (cda896b8-d678-41e5-9437-d9cf767628b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:24 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-1c2d3f14-b6e5-42f3-b3c1-7624fb355d39 tempest-VolumesGetTest-501658789 None] Created volume successfully. Jul 23 22:30:24 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e Jul 23 22:30:24 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:24 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9c37dd21-d553-4d6e-bef2-7c9146a01267 tempest-VolumesActionsTest-1757549985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" returned: 0 in 0.383s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:24 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[30986491-240b-469d-aae0-7cebd3a308b3]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:30:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9c37dd21-d553-4d6e-bef2-7c9146a01267 tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:24 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e Jul 23 22:30:24 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:24 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9c37dd21-d553-4d6e-bef2-7c9146a01267 tempest-VolumesActionsTest-1757549985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" returned: 0 in 0.447s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9c37dd21-d553-4d6e-bef2-7c9146a01267 tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.9e252ad8-f72d-46d4-9eea-fd85735313cahnwgbc7f.img {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:24 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.9e252ad8-f72d-46d4-9eea-fd85735313cahnwgbc7f.img Jul 23 22:30:24 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Acquiring lock "cinder-21d695b1-fd92-4191-ae8f-019296cc5cb9-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Lock "cinder-21d695b1-fd92-4191-ae8f-019296cc5cb9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Acquiring lock "cinder-quobyte-21d695b1-fd92-4191-ae8f-019296cc5cb9" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-21d695b1-fd92-4191-ae8f-019296cc5cb9" acquired by "delete_volume" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:25 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[12aa4c4e-1b8b-4f46-a79a-a288e729222e]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:30:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-21d695b1-fd92-4191-ae8f-019296cc5cb9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:25 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-21d695b1-fd92-4191-ae8f-019296cc5cb9 Jul 23 22:30:25 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:25 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-21d695b1-fd92-4191-ae8f-019296cc5cb9" returned: 0 in 0.676s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-21d695b1-fd92-4191-ae8f-019296cc5cb9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:25 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-21d695b1-fd92-4191-ae8f-019296cc5cb9 Jul 23 22:30:25 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:30:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:26 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:30:26 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:26 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.576s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:30:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:30:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 29 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:30:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:30:26 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-21d695b1-fd92-4191-ae8f-019296cc5cb9" returned: 0 in 0.866s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-21d695b1-fd92-4191-ae8f-019296cc5cb9" released by "delete_volume" :: held 1.633s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:26 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Created reservations ['2f3ef6b7-5fba-4bfb-b503-f4b0effae11f', 'ead8c72c-2466-4478-b9c2-0918874fe08e', '8532bafa-a151-4559-8102-97e434d7d90d', '8c878a2b-c9d9-44bb-b518-6554fb78f700'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:30:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:27 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:30:27 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Acquiring lock "cinder-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Lock "cinder-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:27 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.734s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:28 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:30:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Acquiring lock "cinder-quobyte-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:28 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Deleted volume successfully. Jul 23 22:30:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b" acquired by "delete_volume" :: waited 0.112s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6a0085d9-5000-4808-ae17-93b512a5cdff tempest-VolumesGetTest-501658789 None] Lock "cinder-21d695b1-fd92-4191-ae8f-019296cc5cb9-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:28 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6010ae46-1959-43ef-b0bd-030f311d65f7]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:30:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:28 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b Jul 23 22:30:28 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:29 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b" returned: 0 in 1.243s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:29 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b Jul 23 22:30:29 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:30 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b" returned: 0 in 0.787s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b" released by "delete_volume" :: held 2.192s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:30 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Created reservations ['8d25a1a3-f0ff-4854-9080-224b8658dfc6', '488b9e87-48a3-4c53-b607-cb0a61c8e664', '09d0e607-5679-4018-ba39-4e39bbb50e3a', 'a97571d5-9cc8-4477-8694-9dbc258fb50c'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:30:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:30 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:30:30 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:30 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9c37dd21-d553-4d6e-bef2-7c9146a01267 tempest-VolumesActionsTest-1757549985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.9e252ad8-f72d-46d4-9eea-fd85735313cahnwgbc7f.img" returned: 0 in 5.988s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:30 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d3b6fc-2af5-473e-8965-3ea0459fb407]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:30:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9c37dd21-d553-4d6e-bef2-7c9146a01267 tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:30 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e Jul 23 22:30:30 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:31 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.298s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:31 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:30:31 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Deleted volume successfully. Jul 23 22:30:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f0908268-e531-4cbe-937e-f39c645b332f tempest-VolumesGetTest-501658789 None] Lock "cinder-19e2a646-52e0-4b75-b2d8-c5b2a8d6f23b-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:31 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9c37dd21-d553-4d6e-bef2-7c9146a01267 tempest-VolumesActionsTest-1757549985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" returned: 0 in 0.659s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:31 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-9c37dd21-d553-4d6e-bef2-7c9146a01267 tempest-VolumesActionsTest-1757549985 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.9e252ad8-f72d-46d4-9eea-fd85735313cahnwgbc7f.img {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:30:31 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-9c37dd21-d553-4d6e-bef2-7c9146a01267 tempest-VolumesActionsTest-1757549985 None] Converted 1024.00 MB image at 170.98 MB/s Jul 23 22:30:31 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-9c37dd21-d553-4d6e-bef2-7c9146a01267 tempest-VolumesActionsTest-1757549985 None] 9e252ad8-f72d-46d4-9eea-fd85735313ca was raw, no need to convert to raw {{(pid=88308) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 23 22:30:32 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:30:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Flow 'volume_create_manager' (ae91ed8d-e48e-4399-9fa7-94d241149eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4cabacf-fcf5-4131-88d7-240fe99b9dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4cabacf-fcf5-4131-88d7-240fe99b9dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1780091538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16392cb-2414-4990-8df6-8edeafc370d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67084bfa153c46e5a37ac7d41af70dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:32Z,use_quota=True,user_id='13626a8f3ae043e7aaaa365f543a2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c68224-cf55-4ee5-8d0e-28d5dba06c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c68224-cf55-4ee5-8d0e-28d5dba06c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0966043-05e3-40ba-89a4-c8b81bc2e488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0966043-05e3-40ba-89a4-c8b81bc2e488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b16392cb-2414-4990-8df6-8edeafc370d4', 'volume_name': 'volume-b16392cb-2414-4990-8df6-8edeafc370d4', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef18b8f-140b-43d2-87cc-58661b0b5d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef18b8f-140b-43d2-87cc-58661b0b5d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966dd84e-2c36-4f0f-93bd-9a9f30fd47f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:32 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Volume b16392cb-2414-4990-8df6-8edeafc370d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b16392cb-2414-4990-8df6-8edeafc370d4', 'volume_size': 1} Jul 23 22:30:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:42 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:INSERT=25,cinder:UPDATE=93,cinder:SELECT=79,cinder:DELETE=8 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:30:42 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=79,cinder:INSERT=27,cinder:UPDATE=113,cinder:DELETE=6 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Flow 'volume_create_manager' (cd3aff21-70fe-4771-838c-8ed938b10021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251b1a97-6614-479b-9a1b-b5893e7600ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251b1a97-6614-479b-9a1b-b5893e7600ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1469755007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d00755-d801-4629-9fbd-6a64540de7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d55eac6f6464f1b8390463d4b4e33da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:44Z,use_quota=True,user_id='c6c4f4a3515a4a5697b17a8df9538c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d17377a-8b93-46e7-a22b-6674587c7d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d17377a-8b93-46e7-a22b-6674587c7d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f2e405-ed35-453f-b432-7871c2770093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f2e405-ed35-453f-b432-7871c2770093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8d00755-d801-4629-9fbd-6a64540de7b3', 'volume_name': 'volume-b8d00755-d801-4629-9fbd-6a64540de7b3', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08d6568-5e21-4a40-b939-96da17561d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08d6568-5e21-4a40-b939-96da17561d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a541ec-8d30-43bf-a870-352087a821bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:44 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Volume b8d00755-d801-4629-9fbd-6a64540de7b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8d00755-d801-4629-9fbd-6a64540de7b3', 'volume_size': 1} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Flow 'volume_create_manager' (128dd718-18eb-4c0c-9f4e-66cd624685c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b88cbb-5254-4b39-a6b6-ff8430e7dc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b88cbb-5254-4b39-a6b6-ff8430e7dc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-792938560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb5fbf0-0c55-499f-83ca-7ed99906ef24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d55eac6f6464f1b8390463d4b4e33da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:45Z,use_quota=True,user_id='c6c4f4a3515a4a5697b17a8df9538c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a754ae16-0dec-4cac-a958-444ad4356368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a754ae16-0dec-4cac-a958-444ad4356368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea2132b-8135-4991-89c4-3d1339f0dd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea2132b-8135-4991-89c4-3d1339f0dd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdb5fbf0-0c55-499f-83ca-7ed99906ef24', 'volume_name': 'volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade76bbd-5ff6-4ea6-af42-421cb01467e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade76bbd-5ff6-4ea6-af42-421cb01467e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbb8ab9-d80e-4f1e-96fa-8d7be03c2d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:44 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Volume fdb5fbf0-0c55-499f-83ca-7ed99906ef24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24', 'volume_size': 1} Jul 23 22:30:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9c37dd21-d553-4d6e-bef2-7c9146a01267 tempest-VolumesActionsTest-1757549985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.911s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9c37dd21-d553-4d6e-bef2-7c9146a01267 tempest-VolumesActionsTest-1757549985 None] Uploaded volume to glance image-id: 9e252ad8-f72d-46d4-9eea-fd85735313ca. {{(pid=88308) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 23 22:30:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.347s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-510999197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e006ec-a714-45c6-b7ee-29e75ba60b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc693816173d4d34afb5049d085056cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:23Z,use_quota=True,user_id='695c4ac371aa4ad8989c532e0d4847a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:30:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Creating volume 91e006ec-a714-45c6-b7ee-29e75ba60b56 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:30:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:30:53 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:30:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-91e006ec-a714-45c6-b7ee-29e75ba60b56 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:53 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-91e006ec-a714-45c6-b7ee-29e75ba60b56 1073741824 Jul 23 22:30:53 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-9c37dd21-d553-4d6e-bef2-7c9146a01267 tempest-VolumesActionsTest-1757549985 None] Copy volume to image completed successfully. Jul 23 22:30:53 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:54 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-91e006ec-a714-45c6-b7ee-29e75ba60b56 1073741824" returned: 0 in 0.494s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-91e006ec-a714-45c6-b7ee-29e75ba60b56 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:54 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-91e006ec-a714-45c6-b7ee-29e75ba60b56 Jul 23 22:30:54 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:54 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-91e006ec-a714-45c6-b7ee-29e75ba60b56" returned: 0 in 0.257s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.436s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1780091538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16392cb-2414-4990-8df6-8edeafc370d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67084bfa153c46e5a37ac7d41af70dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:32Z,use_quota=True,user_id='13626a8f3ae043e7aaaa365f543a2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Creating volume b16392cb-2414-4990-8df6-8edeafc370d4 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:30:54 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:54 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 1073741824 Jul 23 22:30:54 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958c3818-14be-4a38-85b6-eb68cf2bed23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e006ec-a714-45c6-b7ee-29e75ba60b56', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da747dc6-be92-411a-ad3a-7aa61c5d0f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:54 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Volume volume-91e006ec-a714-45c6-b7ee-29e75ba60b56 (91e006ec-a714-45c6-b7ee-29e75ba60b56): created successfully Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da747dc6-be92-411a-ad3a-7aa61c5d0f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Flow 'volume_create_manager' (25ba057d-f831-4f7b-8852-cfcfc1094608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:54 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-177b84a7-56b7-46e6-adc9-2a31713eae76 tempest-ProjectReaderTests-562364255 None] Created volume successfully. Jul 23 22:30:55 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 1073741824" returned: 0 in 0.643s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Acquiring lock "cinder-91e006ec-a714-45c6-b7ee-29e75ba60b56-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Lock "cinder-91e006ec-a714-45c6-b7ee-29e75ba60b56-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:55 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 Jul 23 22:30:55 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Acquiring lock "cinder-quobyte-91e006ec-a714-45c6-b7ee-29e75ba60b56" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Lock "cinder-quobyte-91e006ec-a714-45c6-b7ee-29e75ba60b56" acquired by "delete_volume" :: waited 0.058s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2283734b-dbdb-442e-a51f-b9f1e6099faa]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-91e006ec-a714-45c6-b7ee-29e75ba60b56 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:55 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-91e006ec-a714-45c6-b7ee-29e75ba60b56 Jul 23 22:30:55 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:55 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4" returned: 0 in 0.494s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.405s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1469755007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d00755-d801-4629-9fbd-6a64540de7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d55eac6f6464f1b8390463d4b4e33da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:44Z,use_quota=True,user_id='c6c4f4a3515a4a5697b17a8df9538c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Creating volume b8d00755-d801-4629-9fbd-6a64540de7b3 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:30:55 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:30:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b8d00755-d801-4629-9fbd-6a64540de7b3 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966dd84e-2c36-4f0f-93bd-9a9f30fd47f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16392cb-2414-4990-8df6-8edeafc370d4', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ad8e3d-a9e3-4406-9b63-fbc2f0718190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:56 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b8d00755-d801-4629-9fbd-6a64540de7b3 1073741824 Jul 23 22:30:56 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:56 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Volume volume-b16392cb-2414-4990-8df6-8edeafc370d4 (b16392cb-2414-4990-8df6-8edeafc370d4): created successfully Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ad8e3d-a9e3-4406-9b63-fbc2f0718190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Flow 'volume_create_manager' (ae91ed8d-e48e-4399-9fa7-94d241149eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:56 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-313a9b3e-4b67-40ff-b4f8-e4a91a18ab5a tempest-VolumesGetTest-501658789 None] Created volume successfully. Jul 23 22:30:56 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-91e006ec-a714-45c6-b7ee-29e75ba60b56" returned: 0 in 0.511s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-91e006ec-a714-45c6-b7ee-29e75ba60b56 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:56 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-91e006ec-a714-45c6-b7ee-29e75ba60b56 Jul 23 22:30:56 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:56 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-91e006ec-a714-45c6-b7ee-29e75ba60b56" returned: 0 in 0.380s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Lock "cinder-quobyte-91e006ec-a714-45c6-b7ee-29e75ba60b56" released by "delete_volume" :: held 0.988s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Created reservations ['1f1e4240-e173-4a8a-9cf0-919fe3323373', '6229de96-d02e-407b-ade5-42b32417d1d2', '24784241-ae14-4842-bb40-3f4050d4e9d6', '78370372-1eec-42ed-92e6-b80db092e7d9'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:30:56 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b8d00755-d801-4629-9fbd-6a64540de7b3 1073741824" returned: 0 in 0.703s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b8d00755-d801-4629-9fbd-6a64540de7b3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:56 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b8d00755-d801-4629-9fbd-6a64540de7b3 Jul 23 22:30:56 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:56 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:30:56 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:57 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.332s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:30:57 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Deleted volume successfully. Jul 23 22:30:57 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b8d00755-d801-4629-9fbd-6a64540de7b3" returned: 0 in 0.389s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.162s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-792938560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb5fbf0-0c55-499f-83ca-7ed99906ef24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d55eac6f6464f1b8390463d4b4e33da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:45Z,use_quota=True,user_id='c6c4f4a3515a4a5697b17a8df9538c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Creating volume fdb5fbf0-0c55-499f-83ca-7ed99906ef24 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:30:57 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a541ec-8d30-43bf-a870-352087a821bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8d00755-d801-4629-9fbd-6a64540de7b3', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bb38c3-8f05-4ce2-9424-94c3fd3d6132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-909d6d94-318f-4893-ab0e-3dc000472c8c tempest-ProjectReaderTests-562364255 None] Lock "cinder-91e006ec-a714-45c6-b7ee-29e75ba60b56-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:30:57 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24 1073741824 Jul 23 22:30:57 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:57 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Volume volume-b8d00755-d801-4629-9fbd-6a64540de7b3 (b8d00755-d801-4629-9fbd-6a64540de7b3): created successfully Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bb38c3-8f05-4ce2-9424-94c3fd3d6132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Flow 'volume_create_manager' (cd3aff21-70fe-4771-838c-8ed938b10021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:57 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-8b93f8cc-68d6-4218-ae4e-2feba2bafa63 tempest-TestServerVolumeAttachmentScenario-471788892 None] Created volume successfully. Jul 23 22:30:57 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24 1073741824" returned: 0 in 0.849s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Flow 'volume_create_manager' (6f465c91-4383-42cd-a0a9-11f71912a39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ec8773-3be7-49c6-8bda-1fca2493404b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:58 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24 Jul 23 22:30:58 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ec8773-3be7-49c6-8bda-1fca2493404b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-744995432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1ab804-fb2f-4378-9694-d10021d250ce,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='67084bfa153c46e5a37ac7d41af70dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b16392cb-2414-4990-8df6-8edeafc370d4,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:58Z,use_quota=True,user_id='13626a8f3ae043e7aaaa365f543a2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10832f19-7b55-4c30-90d4-caf59ffb6b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10832f19-7b55-4c30-90d4-caf59ffb6b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a44c8d-3c54-43a3-a3fd-5da4dfe5c1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a44c8d-3c54-43a3-a3fd-5da4dfe5c1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6f1ab804-fb2f-4378-9694-d10021d250ce', 'volume_name': 'volume-6f1ab804-fb2f-4378-9694-d10021d250ce', 'volume_size': 1, 'source_volid': 'b16392cb-2414-4990-8df6-8edeafc370d4', 'source_volstatus': 'available'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b562b884-6879-4808-a087-b664ad4fa1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b562b884-6879-4808-a087-b664ad4fa1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eafd3a2-3ad7-4594-9b81-594602702a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:58 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Volume 6f1ab804-fb2f-4378-9694-d10021d250ce: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6f1ab804-fb2f-4378-9694-d10021d250ce', 'volume_size': 1, 'source_volid': 'b16392cb-2414-4990-8df6-8edeafc370d4', 'source_volstatus': 'available'} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:58 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24" returned: 0 in 0.500s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.212s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b654b0-5710-4495-8819-e2e8fc492fba]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbb8ab9-d80e-4f1e-96fa-8d7be03c2d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52434041-1638-4a99-b13d-194a17c01e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Flow 'volume_create_manager' (033ce242-e8b9-4e77-b62d-058e59410e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b3c8b7-0de8-4dd5-90a4-f44fd9d4ba22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:58 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Volume volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24 (fdb5fbf0-0c55-499f-83ca-7ed99906ef24): created successfully Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52434041-1638-4a99-b13d-194a17c01e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Flow 'volume_create_manager' (128dd718-18eb-4c0c-9f4e-66cd624685c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b3c8b7-0de8-4dd5-90a4-f44fd9d4ba22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720825567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54bfb62d-85f6-49c5-8eb4-e546c042e914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc693816173d4d34afb5049d085056cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:59Z,use_quota=True,user_id='695c4ac371aa4ad8989c532e0d4847a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ce7c8c-fd43-4c0d-9efc-697fc98f7c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ce7c8c-fd43-4c0d-9efc-697fc98f7c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6942f4a5-e3b6-4628-8240-5b211f183d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6942f4a5-e3b6-4628-8240-5b211f183d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54bfb62d-85f6-49c5-8eb4-e546c042e914', 'volume_name': 'volume-54bfb62d-85f6-49c5-8eb4-e546c042e914', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab30cf69-0bba-475f-9013-44422ae217fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab30cf69-0bba-475f-9013-44422ae217fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419ecef2-f36f-49b7-8cfb-3f2f5e729ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:30:58 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Volume 54bfb62d-85f6-49c5-8eb4-e546c042e914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54bfb62d-85f6-49c5-8eb4-e546c042e914', 'volume_size': 1} Jul 23 22:30:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:30:58 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-306f210a-083b-41da-870b-7814676ebb38 tempest-TestServerVolumeAttachmentScenario-471788892 None] Created volume successfully. Jul 23 22:30:58 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e Jul 23 22:30:58 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:59 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" returned: 0 in 0.490s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:59 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cf29e6-118d-4f33-8716-f797cebe2fbd]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:30:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:59 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e Jul 23 22:30:59 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:30:59 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Jul 23 22:30:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" returned: 0 in 0.379s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:30:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.8f2d630f-b2a3-4f35-b4bc-183744095548i7ms0m9m.img {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:30:59 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.8f2d630f-b2a3-4f35-b4bc-183744095548i7ms0m9m.img Jul 23 22:30:59 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:04 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.8f2d630f-b2a3-4f35-b4bc-183744095548i7ms0m9m.img" returned: 0 in 5.369s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:04 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8e5e50-81bb-481d-983a-895c353872fd]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:04 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e Jul 23 22:31:04 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:05 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" returned: 0 in 0.532s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:05 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e, size 1024.00 MB, duration 5.37 sec, destination /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.8f2d630f-b2a3-4f35-b4bc-183744095548i7ms0m9m.img {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:31:05 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Converted 1024.00 MB image at 190.68 MB/s Jul 23 22:31:05 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] 8f2d630f-b2a3-4f35-b4bc-183744095548 was raw, converting to qcow2 {{(pid=88308) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 23 22:31:05 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f4c9a3-9baa-4f82-bd27-7c5977f48d40]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.8f2d630f-b2a3-4f35-b4bc-183744095548i7ms0m9m.img {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:05 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.8f2d630f-b2a3-4f35-b4bc-183744095548i7ms0m9m.img Jul 23 22:31:05 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:05 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.8f2d630f-b2a3-4f35-b4bc-183744095548i7ms0m9m.img" returned: 0 in 0.339s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.8f2d630f-b2a3-4f35-b4bc-183744095548i7ms0m9m.img {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:05 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.8f2d630f-b2a3-4f35-b4bc-183744095548i7ms0m9m.img Jul 23 22:31:05 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:06 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.8f2d630f-b2a3-4f35-b4bc-183744095548i7ms0m9m.img" returned: 1 in 0.337s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.8f2d630f-b2a3-4f35-b4bc-183744095548i7ms0m9m.img' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:31:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.8f2d630f-b2a3-4f35-b4bc-183744095548i7ms0m9m.img /opt/stack/data/cinder/conversion/vol_upload_b74yfvbm {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:06 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.8f2d630f-b2a3-4f35-b4bc-183744095548i7ms0m9m.img /opt/stack/data/cinder/conversion/vol_upload_b74yfvbm Jul 23 22:31:06 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:06 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.8f2d630f-b2a3-4f35-b4bc-183744095548i7ms0m9m.img /opt/stack/data/cinder/conversion/vol_upload_b74yfvbm" returned: 0 in 0.261s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:06 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Image conversion details: src /opt/stack/data/cinder/conversion/f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e.temp_image.8f2d630f-b2a3-4f35-b4bc-183744095548i7ms0m9m.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_b74yfvbm {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:31:06 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 23 22:31:06 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce40e522-258d-4456-8b11-48df163f6aba]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_b74yfvbm {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:06 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_b74yfvbm Jul 23 22:31:06 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:06 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_b74yfvbm" returned: 0 in 0.371s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.663s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Uploaded volume to glance image-id: 8f2d630f-b2a3-4f35-b4bc-183744095548. {{(pid=88308) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 23 22:31:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.984s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:08 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Cloning volume b16392cb-2414-4990-8df6-8edeafc370d4 to volume 6f1ab804-fb2f-4378-9694-d10021d250ce Jul 23 22:31:08 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e9afd1f3-6f79-4c87-bee0-1dd72f9ceddd tempest-VolumesActionsTest-1757549985 None] Copy volume to image completed successfully. Jul 23 22:31:08 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Creating offline snapshot 4e00bec4-204d-4874-868d-521e1088311d of volume b16392cb-2414-4990-8df6-8edeafc370d4 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:31:08 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27c8a1c-b8a1-40e9-bc0e-a1afe66737a2]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:08 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 Jul 23 22:31:08 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:08 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4" returned: 0 in 0.353s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:08 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d 1G Jul 23 22:31:08 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:09 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d 1G" returned: 0 in 0.397s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16392cb-2414-4990-8df6-8edeafc370d4 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:09 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16392cb-2414-4990-8df6-8edeafc370d4 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d Jul 23 22:31:09 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:09 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16392cb-2414-4990-8df6-8edeafc370d4 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d" returned: 0 in 0.306s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:09 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d is being set with open permissions: ugo+rw Jul 23 22:31:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:09 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d Jul 23 22:31:09 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:09 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d" returned: 0 in 0.262s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:09 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.info Jul 23 22:31:09 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Acquiring lock "cinder-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Lock "cinder-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Acquiring lock "cinder-quobyte-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Lock "cinder-quobyte-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" acquired by "delete_volume" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:09 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05f072a-3886-48fe-82ac-146b5cda3ff2]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:09 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e Jul 23 22:31:09 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:09 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.info" returned: 0 in 0.269s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:09 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.info is being set with open permissions: ugo+rw Jul 23 22:31:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:09 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.info Jul 23 22:31:09 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:10 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" returned: 0 in 0.371s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:10 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e Jul 23 22:31:10 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:10 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.info" returned: 0 in 0.271s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Acquiring lock "cinder-quobyte-6f1ab804-fb2f-4378-9694-d10021d250ce" by "_copy_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-6f1ab804-fb2f-4378-9694-d10021d250ce" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] snapshot: 4e00bec4-204d-4874-868d-521e1088311d, volume: 6f1ab804-fb2f-4378-9694-d10021d250ce, {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a3d97b-2c96-4aab-b4ef-bb8d6fb71eb9]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:10 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d Jul 23 22:31:10 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:10 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" returned: 0 in 0.257s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Lock "cinder-quobyte-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e" released by "delete_volume" :: held 0.669s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Created reservations ['96c6e55c-7319-4fe3-9baa-c47793eb3ebe', 'c329bfe8-167f-468c-8693-fc02d967f085', 'f3403c86-17dd-4f23-9b11-f92493996af8', '3b5459b2-62f2-454c-96a8-2d11301b09e2'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:10 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:31:10 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:10 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d" returned: 0 in 0.401s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16392cb-2414-4990-8df6-8edeafc370d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Creating direct copy from snapshot {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[726fadc6-c6d9-4a3f-8703-a82441aee7b1]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:10 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 Jul 23 22:31:10 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:10 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.301s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:31:10 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Deleted volume successfully. Jul 23 22:31:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de1dd65a-0cf9-42e1-bf85-30dd6afae949 tempest-VolumesActionsTest-1757549985 None] Lock "cinder-f9dd68cd-aba4-4079-a7c6-f7f03b2dbb8e-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:11 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4" returned: 0 in 0.428s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:11 devstack cinder-volume[88308]: DEBUG cinder.utils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Path /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f1ab804-fb2f-4378-9694-d10021d250ce not found in is_blk_device check {{(pid=88308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 22:31:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f1ab804-fb2f-4378-9694-d10021d250ce {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:11 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f1ab804-fb2f-4378-9694-d10021d250ce Jul 23 22:31:11 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:16 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f1ab804-fb2f-4378-9694-d10021d250ce" returned: 0 in 5.570s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:16 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba83496e-5a10-4f4e-95c8-221e1a25df97]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:16 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 Jul 23 22:31:16 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:17 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4" returned: 0 in 0.653s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:17 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4, size 1024.00 MB, duration 5.57 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f1ab804-fb2f-4378-9694-d10021d250ce {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:31:17 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Converted 1024.00 MB image at 183.79 MB/s Jul 23 22:31:17 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f1ab804-fb2f-4378-9694-d10021d250ce is being set with open permissions: ugo+rw Jul 23 22:31:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f1ab804-fb2f-4378-9694-d10021d250ce {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:17 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f1ab804-fb2f-4378-9694-d10021d250ce Jul 23 22:31:17 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:17 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f1ab804-fb2f-4378-9694-d10021d250ce" returned: 0 in 0.274s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-6f1ab804-fb2f-4378-9694-d10021d250ce" released by "_copy_volume_from_snapshot" :: held 7.419s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Acquiring lock "cinder-quobyte-4e00bec4-204d-4874-868d-521e1088311d" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-4e00bec4-204d-4874-868d-521e1088311d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Deleting offline snapshot 4e00bec4-204d-4874-868d-521e1088311d of volume b16392cb-2414-4990-8df6-8edeafc370d4 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:31:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] snapshot_file for this snap is: volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:31:17 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[415ab3c7-2b23-4a7a-9db9-e54a41a73f55]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:17 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d Jul 23 22:31:17 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:18 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d" returned: 0 in 0.432s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16392cb-2414-4990-8df6-8edeafc370d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:31:18 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e332614-a92b-4277-bc5b-1425dfd6fe88]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:18 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 Jul 23 22:31:18 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:18 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4" returned: 0 in 0.391s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:18 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d Jul 23 22:31:18 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:19 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d" returned: 0 in 0.382s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:19 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d Jul 23 22:31:19 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:19 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4.4e00bec4-204d-4874-868d-521e1088311d" returned: 0 in 0.296s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-4e00bec4-204d-4874-868d-521e1088311d" released by "_delete_snapshot" :: held 1.629s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.118s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.581s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720825567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54bfb62d-85f6-49c5-8eb4-e546c042e914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc693816173d4d34afb5049d085056cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:30:59Z,use_quota=True,user_id='695c4ac371aa4ad8989c532e0d4847a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Creating volume 54bfb62d-85f6-49c5-8eb4-e546c042e914 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:31:19 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-54bfb62d-85f6-49c5-8eb4-e546c042e914 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:19 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-54bfb62d-85f6-49c5-8eb4-e546c042e914 1073741824 Jul 23 22:31:19 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eafd3a2-3ad7-4594-9b81-594602702a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f1ab804-fb2f-4378-9694-d10021d250ce', 'volume_size': 1, 'source_volid': 'b16392cb-2414-4990-8df6-8edeafc370d4', 'source_volstatus': 'available'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04807faf-df65-445b-b33d-ebf0f890b23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:19 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Volume volume-6f1ab804-fb2f-4378-9694-d10021d250ce (6f1ab804-fb2f-4378-9694-d10021d250ce): created successfully Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04807faf-df65-445b-b33d-ebf0f890b23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Flow 'volume_create_manager' (6f465c91-4383-42cd-a0a9-11f71912a39d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:31:19 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a69a48c8-82c8-4ff5-a63c-4c82860fd67a tempest-VolumesGetTest-501658789 None] Created volume successfully. Jul 23 22:31:19 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-54bfb62d-85f6-49c5-8eb4-e546c042e914 1073741824" returned: 0 in 0.481s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-54bfb62d-85f6-49c5-8eb4-e546c042e914 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:19 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-54bfb62d-85f6-49c5-8eb4-e546c042e914 Jul 23 22:31:19 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Flow 'volume_create_manager' (2249141e-1fa7-427f-b834-26a6b2bbb4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e6f0c6-6ad5-4333-b4e4-3b876728f5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e6f0c6-6ad5-4333-b4e4-3b876728f5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1336886213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c618ff7-2eae-4151-9ad7-216a8c55b135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d65b42b4e58d4b1bbbc4f6cec49be955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:31:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:31:20Z,use_quota=True,user_id='f9ad25e99bee41559ebaf076d0a9a926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343bec4d-f5c1-44ef-9633-8a3d4f9da7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343bec4d-f5c1-44ef-9633-8a3d4f9da7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff3b5e8-ed91-477d-af53-06f4fa942a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff3b5e8-ed91-477d-af53-06f4fa942a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c618ff7-2eae-4151-9ad7-216a8c55b135', 'volume_name': 'volume-2c618ff7-2eae-4151-9ad7-216a8c55b135', 'volume_size': 2}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80966ccd-76eb-4f24-bd15-8dc978c993f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80966ccd-76eb-4f24-bd15-8dc978c993f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645795da-4af0-4482-b9c3-2b4f5afb6f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:20 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Volume 2c618ff7-2eae-4151-9ad7-216a8c55b135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c618ff7-2eae-4151-9ad7-216a8c55b135', 'volume_size': 2} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:20 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-54bfb62d-85f6-49c5-8eb4-e546c042e914" returned: 0 in 0.254s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.135s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1336886213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c618ff7-2eae-4151-9ad7-216a8c55b135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d65b42b4e58d4b1bbbc4f6cec49be955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:31:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:31:20Z,use_quota=True,user_id='f9ad25e99bee41559ebaf076d0a9a926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Creating volume 2c618ff7-2eae-4151-9ad7-216a8c55b135 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:31:20 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2c618ff7-2eae-4151-9ad7-216a8c55b135 2147483648 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:20 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2c618ff7-2eae-4151-9ad7-216a8c55b135 2147483648 Jul 23 22:31:20 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419ecef2-f36f-49b7-8cfb-3f2f5e729ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54bfb62d-85f6-49c5-8eb4-e546c042e914', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a925b501-1db4-43e2-842e-fd3226ee1510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:20 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Volume volume-54bfb62d-85f6-49c5-8eb4-e546c042e914 (54bfb62d-85f6-49c5-8eb4-e546c042e914): created successfully Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a925b501-1db4-43e2-842e-fd3226ee1510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Flow 'volume_create_manager' (033ce242-e8b9-4e77-b62d-058e59410e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:31:20 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-33e168d4-11e0-4a5f-9ab8-d57fff3f2900 tempest-ProjectReaderTests-562364255 None] Created volume successfully. Jul 23 22:31:20 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2c618ff7-2eae-4151-9ad7-216a8c55b135 2147483648" returned: 0 in 0.509s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2c618ff7-2eae-4151-9ad7-216a8c55b135 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:20 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2c618ff7-2eae-4151-9ad7-216a8c55b135 Jul 23 22:31:20 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Flow 'volume_create_manager' (3538e22a-2f77-4e55-8ad4-f8ba3c773def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:31:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc418c7a-86fe-484b-a259-972f269a1a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc418c7a-86fe-484b-a259-972f269a1a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:31:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-195826964',display_name='tempest-VolumesGetTest-Volume-1364973306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053eff69-33a9-416f-91c1-cdb2e46a6922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67084bfa153c46e5a37ac7d41af70dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:31:21Z,use_quota=True,user_id='13626a8f3ae043e7aaaa365f543a2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a52aa7b-11e3-4410-9d8f-3343017fdc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a52aa7b-11e3-4410-9d8f-3343017fdc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26591fea-be77-4b42-8a1d-8c5833209e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:21 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26591fea-be77-4b42-8a1d-8c5833209e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '053eff69-33a9-416f-91c1-cdb2e46a6922', 'volume_name': 'volume-053eff69-33a9-416f-91c1-cdb2e46a6922', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd1c08d-f98e-415e-b639-d38e7b9a6011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd1c08d-f98e-415e-b639-d38e7b9a6011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f7916a-313b-47f3-a6ce-afad38373497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:21 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Volume 053eff69-33a9-416f-91c1-cdb2e46a6922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-053eff69-33a9-416f-91c1-cdb2e46a6922', 'volume_size': 1} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2c618ff7-2eae-4151-9ad7-216a8c55b135" returned: 0 in 0.347s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:31:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-195826964',display_name='tempest-VolumesGetTest-Volume-1364973306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053eff69-33a9-416f-91c1-cdb2e46a6922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67084bfa153c46e5a37ac7d41af70dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:31:21Z,use_quota=True,user_id='13626a8f3ae043e7aaaa365f543a2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Creating volume 053eff69-33a9-416f-91c1-cdb2e46a6922 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:31:21 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-053eff69-33a9-416f-91c1-cdb2e46a6922 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Acquiring lock "cinder-54bfb62d-85f6-49c5-8eb4-e546c042e914-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:21 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-053eff69-33a9-416f-91c1-cdb2e46a6922 1073741824 Jul 23 22:31:21 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645795da-4af0-4482-b9c3-2b4f5afb6f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c618ff7-2eae-4151-9ad7-216a8c55b135', 'volume_size': 2}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc74f1d8-c7ad-454b-a536-639e25a40058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:21 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Volume volume-2c618ff7-2eae-4151-9ad7-216a8c55b135 (2c618ff7-2eae-4151-9ad7-216a8c55b135): created successfully Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc74f1d8-c7ad-454b-a536-639e25a40058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Flow 'volume_create_manager' (2249141e-1fa7-427f-b834-26a6b2bbb4e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Lock "cinder-54bfb62d-85f6-49c5-8eb4-e546c042e914-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:21 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f5006ee3-d7cd-4854-af48-8b301de69b40 tempest-VolumesCloneNegativeTest-2006810940 None] Created volume successfully. Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Acquiring lock "cinder-quobyte-54bfb62d-85f6-49c5-8eb4-e546c042e914" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Lock "cinder-quobyte-54bfb62d-85f6-49c5-8eb4-e546c042e914" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bc3114-7050-4941-b179-ada8aae6820a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-54bfb62d-85f6-49c5-8eb4-e546c042e914 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:21 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-54bfb62d-85f6-49c5-8eb4-e546c042e914 Jul 23 22:31:21 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:21 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-053eff69-33a9-416f-91c1-cdb2e46a6922 1073741824" returned: 0 in 0.514s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-053eff69-33a9-416f-91c1-cdb2e46a6922 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:21 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-54bfb62d-85f6-49c5-8eb4-e546c042e914" returned: 0 in 0.392s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-54bfb62d-85f6-49c5-8eb4-e546c042e914 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:21 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-053eff69-33a9-416f-91c1-cdb2e46a6922 Jul 23 22:31:21 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:21 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-54bfb62d-85f6-49c5-8eb4-e546c042e914 Jul 23 22:31:21 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:21 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-053eff69-33a9-416f-91c1-cdb2e46a6922" returned: 0 in 0.274s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f7916a-313b-47f3-a6ce-afad38373497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-053eff69-33a9-416f-91c1-cdb2e46a6922', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca4bd58-16e1-4291-9452-e98a333f8b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:21 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Volume volume-053eff69-33a9-416f-91c1-cdb2e46a6922 (053eff69-33a9-416f-91c1-cdb2e46a6922): created successfully Jul 23 22:31:21 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca4bd58-16e1-4291-9452-e98a333f8b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Flow 'volume_create_manager' (3538e22a-2f77-4e55-8ad4-f8ba3c773def) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-54bfb62d-85f6-49c5-8eb4-e546c042e914" returned: 0 in 0.317s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Lock "cinder-quobyte-54bfb62d-85f6-49c5-8eb4-e546c042e914" released by "delete_volume" :: held 0.761s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:21 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-555129c4-bf4d-4d13-b92c-e526e804cfbd tempest-VolumesGetTest-501658789 None] Created volume successfully. Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Created reservations ['7722f8ea-b800-4fdc-8d71-6a0944c8a9c3', '19adb5e6-c8b8-424e-a910-cc3db81d25d9', 'a583d25f-6af4-43ac-b66d-8755fb6249e0', '8971876b-f439-4e2d-a49e-786bce4eb35b'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:22 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:31:22 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Acquiring lock "cinder-2c618ff7-2eae-4151-9ad7-216a8c55b135-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Lock "cinder-2c618ff7-2eae-4151-9ad7-216a8c55b135-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Acquiring lock "cinder-quobyte-2c618ff7-2eae-4151-9ad7-216a8c55b135" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Lock "cinder-quobyte-2c618ff7-2eae-4151-9ad7-216a8c55b135" acquired by "delete_volume" :: waited 0.026s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:22 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5580a88-3af8-4348-a721-498070fdb733]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2c618ff7-2eae-4151-9ad7-216a8c55b135 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.357s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-8a22c073-913f-408f-955c-cb789e49f762 req-3daee878-19b3-4058-b30f-daac84b7e369 tempest-TestServerVolumeAttachmentScenario-471788892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-8a22c073-913f-408f-955c-cb789e49f762 req-3daee878-19b3-4058-b30f-daac84b7e369 tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:22 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Deleted volume successfully. Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1334c4af-2e3e-4778-bf3d-dba2b8c04c23]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-8a22c073-913f-408f-955c-cb789e49f762 req-3daee878-19b3-4058-b30f-daac84b7e369 tempest-TestServerVolumeAttachmentScenario-471788892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b8d00755-d801-4629-9fbd-6a64540de7b3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-272d4699-93e5-4ba9-bce2-65cc277e6947 tempest-ProjectReaderTests-562364255 None] Lock "cinder-54bfb62d-85f6-49c5-8eb4-e546c042e914-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:22 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2c618ff7-2eae-4151-9ad7-216a8c55b135 Jul 23 22:31:22 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:22 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b8d00755-d801-4629-9fbd-6a64540de7b3 Jul 23 22:31:22 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:22 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2c618ff7-2eae-4151-9ad7-216a8c55b135" returned: 0 in 0.412s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2c618ff7-2eae-4151-9ad7-216a8c55b135 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:22 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2c618ff7-2eae-4151-9ad7-216a8c55b135 Jul 23 22:31:22 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:22 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-8a22c073-913f-408f-955c-cb789e49f762 req-3daee878-19b3-4058-b30f-daac84b7e369 tempest-TestServerVolumeAttachmentScenario-471788892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b8d00755-d801-4629-9fbd-6a64540de7b3" returned: 0 in 0.411s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-8a22c073-913f-408f-955c-cb789e49f762 req-3daee878-19b3-4058-b30f-daac84b7e369 tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.437s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-8a22c073-913f-408f-955c-cb789e49f762 req-3daee878-19b3-4058-b30f-daac84b7e369 tempest-TestServerVolumeAttachmentScenario-471788892 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-b8d00755-d801-4629-9fbd-6a64540de7b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a0a5b63-8202-40ce-8e3e-33dec07db4c1', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:31:23 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-8a22c073-913f-408f-955c-cb789e49f762 req-3daee878-19b3-4058-b30f-daac84b7e369 tempest-TestServerVolumeAttachmentScenario-471788892 None] attachment_update completed successfully. Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Acquiring lock "cinder-053eff69-33a9-416f-91c1-cdb2e46a6922-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Lock "cinder-053eff69-33a9-416f-91c1-cdb2e46a6922-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Acquiring lock "cinder-quobyte-053eff69-33a9-416f-91c1-cdb2e46a6922" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:23 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2c618ff7-2eae-4151-9ad7-216a8c55b135" returned: 0 in 0.437s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-053eff69-33a9-416f-91c1-cdb2e46a6922" acquired by "delete_volume" :: waited 0.033s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Lock "cinder-quobyte-2c618ff7-2eae-4151-9ad7-216a8c55b135" released by "delete_volume" :: held 0.926s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3eaac2-ab91-40a2-88be-40ee0748c22a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-053eff69-33a9-416f-91c1-cdb2e46a6922 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Created reservations ['4d76c633-ff3e-4276-b065-1501abfe6ba8', 'f05a5c44-e1fb-4840-96b6-3364bd688cad', '61c0e87b-8364-4e28-9838-b3c500a8b610', 'c05b56ba-704c-4481-871d-5593cc317750'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:31:23 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-053eff69-33a9-416f-91c1-cdb2e46a6922 Jul 23 22:31:23 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:23 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:31:23 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:23 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-053eff69-33a9-416f-91c1-cdb2e46a6922" returned: 0 in 0.476s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-053eff69-33a9-416f-91c1-cdb2e46a6922 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:23 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:23 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-053eff69-33a9-416f-91c1-cdb2e46a6922 Jul 23 22:31:23 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.329s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:31:23 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Deleted volume successfully. Jul 23 22:31:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ec6cdfeb-a966-49ca-b423-0afe15a4dddd tempest-VolumesCloneNegativeTest-2006810940 None] Lock "cinder-2c618ff7-2eae-4151-9ad7-216a8c55b135-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:24 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-053eff69-33a9-416f-91c1-cdb2e46a6922" returned: 0 in 0.309s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-053eff69-33a9-416f-91c1-cdb2e46a6922" released by "delete_volume" :: held 0.844s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Created reservations ['11c085d9-e03b-42a5-864b-fbee38c04be3', '7ccc2ba0-cbdb-410e-b311-2d2f72d429e0', 'eb8244b6-2b91-4a5e-955c-960424f698be', 'eee10705-a7da-4fa1-8678-770c7a61c7a6'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:24 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:31:24 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Acquiring lock "cinder-6f1ab804-fb2f-4378-9694-d10021d250ce-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Lock "cinder-6f1ab804-fb2f-4378-9694-d10021d250ce-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Acquiring lock "cinder-quobyte-6f1ab804-fb2f-4378-9694-d10021d250ce" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-6f1ab804-fb2f-4378-9694-d10021d250ce" acquired by "delete_volume" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3f41ca-e06d-4575-bc15-5349585db66a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f1ab804-fb2f-4378-9694-d10021d250ce {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:24 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f1ab804-fb2f-4378-9694-d10021d250ce Jul 23 22:31:24 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:24 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.436s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:31:24 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Deleted volume successfully. Jul 23 22:31:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-30f7cd30-4fe9-4fa3-a1d5-76790c7d8a8c tempest-VolumesGetTest-501658789 None] Lock "cinder-053eff69-33a9-416f-91c1-cdb2e46a6922-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:25 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f1ab804-fb2f-4378-9694-d10021d250ce" returned: 0 in 0.434s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f1ab804-fb2f-4378-9694-d10021d250ce {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:25 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f1ab804-fb2f-4378-9694-d10021d250ce Jul 23 22:31:25 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:25 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f1ab804-fb2f-4378-9694-d10021d250ce" returned: 0 in 0.302s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-6f1ab804-fb2f-4378-9694-d10021d250ce" released by "delete_volume" :: held 0.797s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:25 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Created reservations ['63a5b3e2-5f51-4ee0-bd52-e1c3d44502fd', '90df4a98-0906-4855-a7fa-434364583a8f', '79cec503-a0d6-47bb-8313-2bda6d639fdb', '81316966-5a42-456c-a482-3ebfca243ab1'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:31:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:25 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:31:25 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:25 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.283s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:25 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:31:25 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Deleted volume successfully. Jul 23 22:31:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-99de108a-31cf-4607-8bbf-0296aa5bdd72 tempest-VolumesGetTest-501658789 None] Lock "cinder-6f1ab804-fb2f-4378-9694-d10021d250ce-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Acquiring lock "cinder-b16392cb-2414-4990-8df6-8edeafc370d4-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Lock "cinder-b16392cb-2414-4990-8df6-8edeafc370d4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Acquiring lock "cinder-quobyte-b16392cb-2414-4990-8df6-8edeafc370d4" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-b16392cb-2414-4990-8df6-8edeafc370d4" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:26 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:31:26 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e39f9e6-e336-4c60-923a-38b5e77946cb]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:26 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 Jul 23 22:31:26 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:26 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.345s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 29 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:31:26 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4" returned: 0 in 0.496s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:26 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4 Jul 23 22:31:26 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:26 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b16392cb-2414-4990-8df6-8edeafc370d4" returned: 0 in 0.285s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-b16392cb-2414-4990-8df6-8edeafc370d4" released by "delete_volume" :: held 0.863s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:27 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Created reservations ['cfa658b5-8363-498b-8074-0c6809a44c0b', '04c88f6a-f007-47f2-a36f-28d0d78c8d63', '1ac401b5-2431-461f-af5e-a027bba4118f', '2d667373-1319-4354-8c3e-2fc5fec33746'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:31:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:27 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:31:27 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:27 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.308s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:27 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:31:27 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Deleted volume successfully. Jul 23 22:31:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ffe1d99b-3991-49bb-9ca3-9b16df77d974 tempest-VolumesGetTest-501658789 None] Lock "cinder-b16392cb-2414-4990-8df6-8edeafc370d4-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Flow 'volume_create_manager' (1be94fe8-5bde-4820-985e-17fdf3100b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d2653e-380f-41fb-8b22-ad655734edfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d2653e-380f-41fb-8b22-ad655734edfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-153082547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c2f365-9118-4ceb-bb5e-e681658fc437,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='67084bfa153c46e5a37ac7d41af70dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:31:28Z,use_quota=True,user_id='13626a8f3ae043e7aaaa365f543a2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25285668-8ccb-4c1a-97f5-6d24bb053c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25285668-8ccb-4c1a-97f5-6d24bb053c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a43daeb-cfeb-4033-b875-17adf6e7f704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG cinder.image.glance [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Creating Keystone auth plugin from conf {{(pid=88308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a43daeb-cfeb-4033-b875-17adf6e7f704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c5c2f365-9118-4ceb-bb5e-e681658fc437', 'volume_name': 'volume-c5c2f365-9118-4ceb-bb5e-e681658fc437', 'volume_size': 1, 'image_id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73edeb14970041b0969b3a5428a796ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'created_at': datetime.datetime(2026, 7, 23, 20, 14, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79e9d1bf-6470-4134-adab-55462317ad8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eafff64-4f85-4719-970e-de9d8ae64373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eafff64-4f85-4719-970e-de9d8ae64373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668b206d-f6fd-405d-a904-e8359d293781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:28 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Volume c5c2f365-9118-4ceb-bb5e-e681658fc437: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c5c2f365-9118-4ceb-bb5e-e681658fc437', 'volume_size': 1, 'image_id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73edeb14970041b0969b3a5428a796ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'created_at': datetime.datetime(2026, 7, 23, 20, 14, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79e9d1bf-6470-4134-adab-55462317ad8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Trying to clone c5c2f365-9118-4ceb-bb5e-e681658fc437 from image 79e9d1bf-6470-4134-adab-55462317ad8b at location (None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}]). {{(pid=88308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-b0af92df-d437-49a9-9dd4-c9a32c1810a5 req-18f23de7-291e-467b-964c-826b1a4fcf7e tempest-TestServerVolumeAttachmentScenario-471788892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-b0af92df-d437-49a9-9dd4-c9a32c1810a5 req-18f23de7-291e-467b-964c-826b1a4fcf7e tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ff361b-8344-46f7-bbff-6ef113046171]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-b0af92df-d437-49a9-9dd4-c9a32c1810a5 req-18f23de7-291e-467b-964c-826b1a4fcf7e tempest-TestServerVolumeAttachmentScenario-471788892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:28 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24 Jul 23 22:31:28 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_fdh46f68devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 22:31:29 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Image download 20.69 MB at 20.69 MB/s Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[100f3d0a-4aed-47c8-bf8d-e9fc46d35403]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_fdh46f68devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:29 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_fdh46f68devstack@QuobyteHD Jul 23 22:31:29 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:29 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-b0af92df-d437-49a9-9dd4-c9a32c1810a5 req-18f23de7-291e-467b-964c-826b1a4fcf7e tempest-TestServerVolumeAttachmentScenario-471788892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24" returned: 0 in 0.485s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-b0af92df-d437-49a9-9dd4-c9a32c1810a5 req-18f23de7-291e-467b-964c-826b1a4fcf7e tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.522s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-b0af92df-d437-49a9-9dd4-c9a32c1810a5 req-18f23de7-291e-467b-964c-826b1a4fcf7e tempest-TestServerVolumeAttachmentScenario-471788892 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2eb8f8af-4ae9-4bba-927d-866d6ef5c1fd', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:31:29 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-b0af92df-d437-49a9-9dd4-c9a32c1810a5 req-18f23de7-291e-467b-964c-826b1a4fcf7e tempest-TestServerVolumeAttachmentScenario-471788892 None] attachment_update completed successfully. Jul 23 22:31:29 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_fdh46f68devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Temporary image 79e9d1bf-6470-4134-adab-55462317ad8b is fetched for user 13626a8f3ae043e7aaaa365f543a2b15. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6685cee6-d928-4baa-849d-6975564df3e9]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_fdh46f68devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:29 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_fdh46f68devstack@QuobyteHD Jul 23 22:31:29 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:29 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_fdh46f68devstack@QuobyteHD" returned: 0 in 0.398s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-153082547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c2f365-9118-4ceb-bb5e-e681658fc437,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='67084bfa153c46e5a37ac7d41af70dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:31:28Z,use_quota=True,user_id='13626a8f3ae043e7aaaa365f543a2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Creating volume c5c2f365-9118-4ceb-bb5e-e681658fc437 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:31:29 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:31:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:30 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 1073741824 Jul 23 22:31:30 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:30 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 1073741824" returned: 0 in 0.512s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:30 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 Jul 23 22:31:30 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:30 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437" returned: 0 in 0.281s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:31:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:30 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Attempting download of 79e9d1bf-6470-4134-adab-55462317ad8b ((None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}])) to volume c5c2f365-9118-4ceb-bb5e-e681658fc437. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 22:31:30 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a44dac2-26a3-45f8-b315-1b28b67ffd28]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_fq6dedhz {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:31 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_fq6dedhz Jul 23 22:31:31 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:31 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_fq6dedhz" returned: 0 in 0.458s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_fq6dedhz {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:31 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_fq6dedhz Jul 23 22:31:31 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:31 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_fq6dedhz" returned: 1 in 0.352s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_fq6dedhz' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:31:31 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4af0da-0946-4c99-b77d-94148f94e911]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_fdh46f68devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:31 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-50258e1e-3567-4e93-b791-303cd787b211 req-e94df6c9-41d6-49ae-97c6-5fcc3a2dd3b4 tempest-TestServerVolumeAttachmentScenario-471788892 None] Terminate volume connection completed successfully. Jul 23 22:31:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-50258e1e-3567-4e93-b791-303cd787b211 req-e94df6c9-41d6-49ae-97c6-5fcc3a2dd3b4 tempest-TestServerVolumeAttachmentScenario-471788892 None] Deleting attachment 2eb8f8af-4ae9-4bba-927d-866d6ef5c1fd. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:31:31 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_fdh46f68devstack@QuobyteHD Jul 23 22:31:31 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:32 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_fdh46f68devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:32 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] 79e9d1bf-6470-4134-adab-55462317ad8b was qcow2, converting to raw {{(pid=88308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 22:31:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_fdh46f68devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:32 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_fdh46f68devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 Jul 23 22:31:32 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:33 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-0938be23-0ec0-4c88-a769-f3cf8020e8fd req-3b1b9a94-4ffa-4e8d-ad54-d28229eb7d4d tempest-TestServerVolumeAttachmentScenario-471788892 None] Terminate volume connection completed successfully. Jul 23 22:31:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-0938be23-0ec0-4c88-a769-f3cf8020e8fd req-3b1b9a94-4ffa-4e8d-ad54-d28229eb7d4d tempest-TestServerVolumeAttachmentScenario-471788892 None] Deleting attachment 2a0a5b63-8202-40ce-8e3e-33dec07db4c1. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:31:34 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_fdh46f68devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437" returned: 0 in 2.108s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:34 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_fdh46f68devstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:31:34 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Converted 112.00 MB image at 53.12 MB/s Jul 23 22:31:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:34 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 1G Jul 23 22:31:34 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:34 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 1G" returned: 0 in 0.494s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:34 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c2746c-e148-4b47-a338-4351c54be9a7]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:34 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 Jul 23 22:31:34 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:35 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437" returned: 0 in 0.593s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:35 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 Jul 23 22:31:35 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:35 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437" returned: 1 in 0.461s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:31:35 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Downloaded image 79e9d1bf-6470-4134-adab-55462317ad8b ((None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}])) to volume c5c2f365-9118-4ceb-bb5e-e681658fc437 successfully. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 22:31:35 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Temporary image 79e9d1bf-6470-4134-adab-55462317ad8b for user 13626a8f3ae043e7aaaa365f543a2b15 is deleted. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 22:31:35 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Marking volume c5c2f365-9118-4ceb-bb5e-e681658fc437 as bootable. {{(pid=88308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 22:31:35 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Copying metadata from image 79e9d1bf-6470-4134-adab-55462317ad8b to c5c2f365-9118-4ceb-bb5e-e681658fc437. {{(pid=88308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 22:31:35 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Creating volume glance metadata for volume c5c2f365-9118-4ceb-bb5e-e681658fc437 backed by image 79e9d1bf-6470-4134-adab-55462317ad8b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 22:31:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668b206d-f6fd-405d-a904-e8359d293781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5c2f365-9118-4ceb-bb5e-e681658fc437', 'volume_size': 1, 'image_id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73edeb14970041b0969b3a5428a796ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'created_at': datetime.datetime(2026, 7, 23, 20, 14, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79e9d1bf-6470-4134-adab-55462317ad8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b4f4a5-6f46-4950-a515-f84e97781be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:35 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Volume volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 (c5c2f365-9118-4ceb-bb5e-e681658fc437): created successfully Jul 23 22:31:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b4f4a5-6f46-4950-a515-f84e97781be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Flow 'volume_create_manager' (1be94fe8-5bde-4820-985e-17fdf3100b74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:31:36 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-0fb5bbc6-ee48-4d95-8aca-254c209585d4 tempest-VolumesGetTest-501658789 None] Created volume successfully. Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Flow 'volume_create_manager' (2fac99af-e573-4a7b-acf3-99795f168e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75518892-8781-407a-9950-1687512f778f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75518892-8781-407a-9950-1687512f778f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:31:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1358415621',display_name='tempest-VolumesGetTest-Volume-1987735715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7244cc-c723-4237-8c48-4f23f3f1c88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67084bfa153c46e5a37ac7d41af70dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:31:38Z,use_quota=True,user_id='13626a8f3ae043e7aaaa365f543a2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65532c19-bb6f-42b3-a3dd-82f2f2368809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65532c19-bb6f-42b3-a3dd-82f2f2368809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc38369-bf8c-46ad-8817-140183ad0559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc38369-bf8c-46ad-8817-140183ad0559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7244cc-c723-4237-8c48-4f23f3f1c88a', 'volume_name': 'volume-db7244cc-c723-4237-8c48-4f23f3f1c88a', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c9ae7e-db42-4fd4-b2eb-6a7e77604241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c9ae7e-db42-4fd4-b2eb-6a7e77604241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd8445d-6e53-44cf-93a6-2ad457b1028b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:37 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Volume db7244cc-c723-4237-8c48-4f23f3f1c88a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7244cc-c723-4237-8c48-4f23f3f1c88a', 'volume_size': 1} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:31:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1358415621',display_name='tempest-VolumesGetTest-Volume-1987735715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7244cc-c723-4237-8c48-4f23f3f1c88a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67084bfa153c46e5a37ac7d41af70dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:31:38Z,use_quota=True,user_id='13626a8f3ae043e7aaaa365f543a2b15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Creating volume db7244cc-c723-4237-8c48-4f23f3f1c88a {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:31:37 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:31:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db7244cc-c723-4237-8c48-4f23f3f1c88a 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:37 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db7244cc-c723-4237-8c48-4f23f3f1c88a 1073741824 Jul 23 22:31:37 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:38 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db7244cc-c723-4237-8c48-4f23f3f1c88a 1073741824" returned: 0 in 0.543s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db7244cc-c723-4237-8c48-4f23f3f1c88a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:38 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db7244cc-c723-4237-8c48-4f23f3f1c88a Jul 23 22:31:38 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:38 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db7244cc-c723-4237-8c48-4f23f3f1c88a" returned: 0 in 0.314s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:38 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:31:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd8445d-6e53-44cf-93a6-2ad457b1028b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7244cc-c723-4237-8c48-4f23f3f1c88a', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38490d5-bb01-400f-8dd7-b2be6fe726e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:38 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Volume volume-db7244cc-c723-4237-8c48-4f23f3f1c88a (db7244cc-c723-4237-8c48-4f23f3f1c88a): created successfully Jul 23 22:31:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38490d5-bb01-400f-8dd7-b2be6fe726e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Flow 'volume_create_manager' (2fac99af-e573-4a7b-acf3-99795f168e28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:31:38 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-5ca6a30e-dbeb-4695-a779-06fb6566fc10 tempest-VolumesGetTest-501658789 None] Created volume successfully. Jul 23 22:31:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Acquiring lock "cinder-fdb5fbf0-0c55-499f-83ca-7ed99906ef24-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "cinder-fdb5fbf0-0c55-499f-83ca-7ed99906ef24-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Acquiring lock "cinder-quobyte-fdb5fbf0-0c55-499f-83ca-7ed99906ef24" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "cinder-quobyte-fdb5fbf0-0c55-499f-83ca-7ed99906ef24" acquired by "delete_volume" :: waited 0.025s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:39 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbe609e-34cf-4620-a13a-9ee78e2b7352]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:39 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24 Jul 23 22:31:39 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:39 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24" returned: 0 in 0.402s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:39 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24 Jul 23 22:31:39 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:39 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fdb5fbf0-0c55-499f-83ca-7ed99906ef24" returned: 0 in 0.293s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "cinder-quobyte-fdb5fbf0-0c55-499f-83ca-7ed99906ef24" released by "delete_volume" :: held 0.742s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Acquiring lock "cinder-db7244cc-c723-4237-8c48-4f23f3f1c88a-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Lock "cinder-db7244cc-c723-4237-8c48-4f23f3f1c88a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Acquiring lock "cinder-quobyte-db7244cc-c723-4237-8c48-4f23f3f1c88a" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-db7244cc-c723-4237-8c48-4f23f3f1c88a" acquired by "delete_volume" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Created reservations ['3cb2e35e-41a8-4bc5-b6ec-0d23f71564d5', '4d31af0b-27cb-4468-a437-26044b74a5cb', '2fc5048f-40c9-409e-ab50-722c8f887bc7', '44a0cd43-f91b-4bb4-b673-c6bb771b0f7e'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00a682c-cb12-4c6a-9155-078f27b1ab05]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db7244cc-c723-4237-8c48-4f23f3f1c88a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:40 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:31:40 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:40 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db7244cc-c723-4237-8c48-4f23f3f1c88a Jul 23 22:31:40 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Acquiring lock "cinder-b8d00755-d801-4629-9fbd-6a64540de7b3-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "cinder-b8d00755-d801-4629-9fbd-6a64540de7b3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Acquiring lock "cinder-quobyte-b8d00755-d801-4629-9fbd-6a64540de7b3" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "cinder-quobyte-b8d00755-d801-4629-9fbd-6a64540de7b3" acquired by "delete_volume" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[26598797-8a15-4a4b-8a46-f87b88370dde]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b8d00755-d801-4629-9fbd-6a64540de7b3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:40 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.354s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:31:40 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Deleted volume successfully. Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3268da49-3acb-45f7-a879-eb6ca9bf92ce tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "cinder-fdb5fbf0-0c55-499f-83ca-7ed99906ef24-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:40 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db7244cc-c723-4237-8c48-4f23f3f1c88a" returned: 0 in 0.538s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db7244cc-c723-4237-8c48-4f23f3f1c88a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:40 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b8d00755-d801-4629-9fbd-6a64540de7b3 Jul 23 22:31:40 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:40 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db7244cc-c723-4237-8c48-4f23f3f1c88a Jul 23 22:31:40 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:40 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db7244cc-c723-4237-8c48-4f23f3f1c88a" returned: 0 in 0.292s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:40 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b8d00755-d801-4629-9fbd-6a64540de7b3" returned: 0 in 0.431s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b8d00755-d801-4629-9fbd-6a64540de7b3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-db7244cc-c723-4237-8c48-4f23f3f1c88a" released by "delete_volume" :: held 0.891s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:40 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b8d00755-d801-4629-9fbd-6a64540de7b3 Jul 23 22:31:40 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Created reservations ['2b46a22a-249e-4764-8e82-35788c7f5c18', 'aeaa067c-5f99-4df5-aa99-13c491e34d50', '4d59ef7e-513d-43d1-9b12-19fa4aa2fd91', 'b264027a-319e-45df-9cb8-1c5f02ccaeba'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:41 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:31:41 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:41 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b8d00755-d801-4629-9fbd-6a64540de7b3" returned: 0 in 0.310s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Acquiring lock "cinder-c5c2f365-9118-4ceb-bb5e-e681658fc437-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "cinder-quobyte-b8d00755-d801-4629-9fbd-6a64540de7b3" released by "delete_volume" :: held 0.815s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Lock "cinder-c5c2f365-9118-4ceb-bb5e-e681658fc437-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Acquiring lock "cinder-quobyte-c5c2f365-9118-4ceb-bb5e-e681658fc437" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Created reservations ['dd2b615a-5220-493b-b118-06a95cfffaa6', 'c7355607-307f-4548-8c4e-9cad61b308c3', 'fd9bf75a-1e3e-40e5-9ba3-5f3b848acc0a', 'd27d55eb-f293-4ea7-886a-99fc3cf30af4'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-c5c2f365-9118-4ceb-bb5e-e681658fc437" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:31:41 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.330s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:31:41 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Deleted volume successfully. Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e840a451-ab8e-4cf7-b60f-15b239af711f tempest-VolumesGetTest-501658789 None] Lock "cinder-db7244cc-c723-4237-8c48-4f23f3f1c88a-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b48198-89a9-4b8f-9877-a192fb493ba3]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:41 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:31:41 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:41 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 Jul 23 22:31:41 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:41 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.299s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:31:41 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Deleted volume successfully. Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b5db85a2-4f2a-4163-b285-3767e66e6d07 tempest-TestServerVolumeAttachmentScenario-471788892 None] Lock "cinder-b8d00755-d801-4629-9fbd-6a64540de7b3-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:41 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437" returned: 0 in 0.406s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:42 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 Jul 23 22:31:42 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:42 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437" returned: 1 in 0.415s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:31:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:42 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437 Jul 23 22:31:42 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:42 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c5c2f365-9118-4ceb-bb5e-e681658fc437" returned: 0 in 0.322s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Lock "cinder-quobyte-c5c2f365-9118-4ceb-bb5e-e681658fc437" released by "delete_volume" :: held 1.247s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:42 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:UPDATE=127,cinder:SELECT=94,cinder:DELETE=11,cinder:INSERT=24 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:31:42 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=99,cinder:UPDATE=107,cinder:INSERT=41,cinder:DELETE=9 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:31:42 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Created reservations ['effd9657-956e-4af7-997d-e8d161764fd8', '1b08076d-9942-4565-90d8-5ef63f64cef2', '92aef367-4fbb-4c93-9351-82f7ae57d065', 'e7d5a739-8fdf-4f0d-a4ee-fc5a558d7264'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:31:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:42 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:31:42 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:43 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.257s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:43 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:31:43 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Deleted volume successfully. Jul 23 22:31:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-331fe128-bd64-4574-a290-624b411666a6 tempest-VolumesGetTest-501658789 None] Lock "cinder-c5c2f365-9118-4ceb-bb5e-e681658fc437-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:31:52 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=7 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:31:53 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:UPDATE=8,cinder:SELECT=1,cinder:DELETE=1 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:31:53 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:31:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Flow 'volume_create_manager' (e9fbd023-50fa-4796-8d58-0bf1c05114c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:31:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cfeb99-32fa-4e5f-881b-83e55d62a338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cfeb99-32fa-4e5f-881b-83e55d62a338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-749154090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d046d3ef-9f42-4a36-98be-ae663c2aa8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e13fb879a58c4abf818e8bfe8fa6acc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:31:54Z,use_quota=True,user_id='af93a2cbfd1e4a4b801e8dcf4eac1b61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c402664b-6a26-4eb0-a584-efeac03b28c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c402664b-6a26-4eb0-a584-efeac03b28c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3be7b5-e90a-4de0-9693-45891e1e58a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:53 devstack cinder-volume[88308]: DEBUG cinder.image.glance [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Creating Keystone auth plugin from conf {{(pid=88308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 22:31:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3be7b5-e90a-4de0-9693-45891e1e58a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd046d3ef-9f42-4a36-98be-ae663c2aa8b2', 'volume_name': 'volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2', 'volume_size': 1, 'image_id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73edeb14970041b0969b3a5428a796ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'created_at': datetime.datetime(2026, 7, 23, 20, 14, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79e9d1bf-6470-4134-adab-55462317ad8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e5a8a6-7522-4eab-a06c-f2983f8151a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e5a8a6-7522-4eab-a06c-f2983f8151a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:31:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab6f32a-396d-4179-ad9c-e79536875f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:31:54 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Volume d046d3ef-9f42-4a36-98be-ae663c2aa8b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2', 'volume_size': 1, 'image_id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73edeb14970041b0969b3a5428a796ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'created_at': datetime.datetime(2026, 7, 23, 20, 14, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79e9d1bf-6470-4134-adab-55462317ad8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 23 22:31:54 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Trying to clone d046d3ef-9f42-4a36-98be-ae663c2aa8b2 from image 79e9d1bf-6470-4134-adab-55462317ad8b at location (None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}]). {{(pid=88308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 22:31:54 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_t1adeheidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 22:31:54 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Image download 20.69 MB at 20.69 MB/s Jul 23 22:31:54 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe19b11-47c2-4a81-bc97-68e5ab6da65c]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_t1adeheidevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:54 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_t1adeheidevstack@QuobyteHD Jul 23 22:31:54 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:55 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_t1adeheidevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:55 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Temporary image 79e9d1bf-6470-4134-adab-55462317ad8b is fetched for user af93a2cbfd1e4a4b801e8dcf4eac1b61. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 22:31:55 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0212f4b8-7681-47bf-82ec-cc66261658ad]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_t1adeheidevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:55 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_t1adeheidevstack@QuobyteHD Jul 23 22:31:55 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:55 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_t1adeheidevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-749154090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d046d3ef-9f42-4a36-98be-ae663c2aa8b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e13fb879a58c4abf818e8bfe8fa6acc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:31:54Z,use_quota=True,user_id='af93a2cbfd1e4a4b801e8dcf4eac1b61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:31:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Creating volume d046d3ef-9f42-4a36-98be-ae663c2aa8b2 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:31:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:31:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:31:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:31:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:31:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:31:55 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:31:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:55 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 1073741824 Jul 23 22:31:55 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:56 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 1073741824" returned: 0 in 0.508s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:56 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 Jul 23 22:31:56 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:56 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2" returned: 0 in 0.274s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:31:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:31:56 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Attempting download of 79e9d1bf-6470-4134-adab-55462317ad8b ((None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}])) to volume d046d3ef-9f42-4a36-98be-ae663c2aa8b2. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 22:31:56 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[599cb830-e73f-4210-878e-f6a0d0b16b84]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_2r_rth3e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:56 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_2r_rth3e Jul 23 22:31:56 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:57 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_2r_rth3e" returned: 0 in 0.400s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_2r_rth3e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:57 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_2r_rth3e Jul 23 22:31:57 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:57 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_2r_rth3e" returned: 1 in 0.388s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79e9d1bf-6470-4134-adab-55462317ad8b_2r_rth3e' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:31:57 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[74516313-c54c-44a5-a3fc-9e2bb3347d3d]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:31:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_t1adeheidevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:57 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_t1adeheidevstack@QuobyteHD Jul 23 22:31:57 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:57 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_t1adeheidevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:57 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] 79e9d1bf-6470-4134-adab-55462317ad8b was qcow2, converting to raw {{(pid=88308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 22:31:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_t1adeheidevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:57 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_t1adeheidevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 Jul 23 22:31:57 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:31:59 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Jul 23 22:31:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_t1adeheidevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2" returned: 0 in 1.942s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:31:59 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_79e9d1bf-6470-4134-adab-55462317ad8b_t1adeheidevstack@QuobyteHD, size 112.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:31:59 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Converted 112.00 MB image at 57.63 MB/s Jul 23 22:31:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:31:59 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 1G Jul 23 22:31:59 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:00 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 1G" returned: 0 in 0.331s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:00 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e722b029-2bb4-4077-8ab7-d92c20434fb6]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:32:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:00 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 Jul 23 22:32:00 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:00 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2" returned: 0 in 0.464s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:00 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 Jul 23 22:32:00 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:01 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2" returned: 1 in 0.424s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:32:01 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Downloaded image 79e9d1bf-6470-4134-adab-55462317ad8b ((None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}])) to volume d046d3ef-9f42-4a36-98be-ae663c2aa8b2 successfully. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 22:32:01 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Temporary image 79e9d1bf-6470-4134-adab-55462317ad8b for user af93a2cbfd1e4a4b801e8dcf4eac1b61 is deleted. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 22:32:01 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Marking volume d046d3ef-9f42-4a36-98be-ae663c2aa8b2 as bootable. {{(pid=88308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 22:32:01 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Copying metadata from image 79e9d1bf-6470-4134-adab-55462317ad8b to d046d3ef-9f42-4a36-98be-ae663c2aa8b2. {{(pid=88308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 22:32:01 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Creating volume glance metadata for volume d046d3ef-9f42-4a36-98be-ae663c2aa8b2 backed by image 79e9d1bf-6470-4134-adab-55462317ad8b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 22:32:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab6f32a-396d-4179-ad9c-e79536875f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2', 'volume_size': 1, 'image_id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79e9d1bf-6470-4134-adab-55462317ad8b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '73edeb14970041b0969b3a5428a796ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '79e9d1bf-6470-4134-adab-55462317ad8b', 'created_at': datetime.datetime(2026, 7, 23, 20, 14, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79e9d1bf-6470-4134-adab-55462317ad8b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1786bc2d-a97c-498a-a218-ff04737a05a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:01 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Volume volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 (d046d3ef-9f42-4a36-98be-ae663c2aa8b2): created successfully Jul 23 22:32:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1786bc2d-a97c-498a-a218-ff04737a05a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:01 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Flow 'volume_create_manager' (e9fbd023-50fa-4796-8d58-0bf1c05114c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:32:01 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-11bc0423-7a31-4c2e-859b-6326d18c4bfc tempest-TestShelveInstance-1157895983 None] Created volume successfully. Jul 23 22:32:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-fa9a66ca-7ef5-410b-8ab2-31204699ef0e req-e8496cc5-f929-4bb8-8c2b-6acac525380d tempest-TestShelveInstance-1157895983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:32:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-fa9a66ca-7ef5-410b-8ab2-31204699ef0e req-e8496cc5-f929-4bb8-8c2b-6acac525380d tempest-TestShelveInstance-1157895983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:32:04 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc24fde5-76ec-480c-81eb-f6dba8b83c80]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:32:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-fa9a66ca-7ef5-410b-8ab2-31204699ef0e req-e8496cc5-f929-4bb8-8c2b-6acac525380d tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:05 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 Jul 23 22:32:05 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:05 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-fa9a66ca-7ef5-410b-8ab2-31204699ef0e req-e8496cc5-f929-4bb8-8c2b-6acac525380d tempest-TestShelveInstance-1157895983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2" returned: 0 in 0.410s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-fa9a66ca-7ef5-410b-8ab2-31204699ef0e req-e8496cc5-f929-4bb8-8c2b-6acac525380d tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:05 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 Jul 23 22:32:05 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:05 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-fa9a66ca-7ef5-410b-8ab2-31204699ef0e req-e8496cc5-f929-4bb8-8c2b-6acac525380d tempest-TestShelveInstance-1157895983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2" returned: 1 in 0.406s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-fa9a66ca-7ef5-410b-8ab2-31204699ef0e req-e8496cc5-f929-4bb8-8c2b-6acac525380d tempest-TestShelveInstance-1157895983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:32:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-fa9a66ca-7ef5-410b-8ab2-31204699ef0e req-e8496cc5-f929-4bb8-8c2b-6acac525380d tempest-TestShelveInstance-1157895983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.899s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:32:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-fa9a66ca-7ef5-410b-8ab2-31204699ef0e req-e8496cc5-f929-4bb8-8c2b-6acac525380d tempest-TestShelveInstance-1157895983 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00fae1c1-b48a-4848-be18-18ed8d935c53', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:32:05 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-fa9a66ca-7ef5-410b-8ab2-31204699ef0e req-e8496cc5-f929-4bb8-8c2b-6acac525380d tempest-TestShelveInstance-1157895983 None] attachment_update completed successfully. Jul 23 22:32:15 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=14,cinder:INSERT=9,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:32:15 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5,cinder:INSERT=5 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Flow 'volume_create_manager' (8b629278-7a1d-448d-8833-e8bc15fa9d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cf13af-2ba6-40a4-9d84-ed6d9067821c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cf13af-2ba6-40a4-9d84-ed6d9067821c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-100943311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511dba60-ea92-424e-b2b8-892442b41c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f765e614a62145fa8f8882b1dd662321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:32:25Z,use_quota=True,user_id='045d7c33a6a1460a95b7086ba6b2f473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbf1134-b707-4574-90a8-0f71d0bb2499),volume_type_id=1cbf1134-b707-4574-90a8-0f71d0bb2499)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c0c100-0ed2-41b3-8e07-705285a466f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c0c100-0ed2-41b3-8e07-705285a466f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4e7886-d3d8-4ab6-ab8f-c8668c8ab07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4e7886-d3d8-4ab6-ab8f-c8668c8ab07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '511dba60-ea92-424e-b2b8-892442b41c31', 'volume_name': 'volume-511dba60-ea92-424e-b2b8-892442b41c31', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2ccb68-aa2f-413e-8e0b-3cfe94a21928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2ccb68-aa2f-413e-8e0b-3cfe94a21928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797332a0-8c52-445c-a9b1-cdfc9955aa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:25 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Volume 511dba60-ea92-424e-b2b8-892442b41c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-511dba60-ea92-424e-b2b8-892442b41c31', 'volume_size': 1} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-100943311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511dba60-ea92-424e-b2b8-892442b41c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f765e614a62145fa8f8882b1dd662321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:32:25Z,use_quota=True,user_id='045d7c33a6a1460a95b7086ba6b2f473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cbf1134-b707-4574-90a8-0f71d0bb2499),volume_type_id=1cbf1134-b707-4574-90a8-0f71d0bb2499)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Creating volume 511dba60-ea92-424e-b2b8-892442b41c31 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:32:25 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:32:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-511dba60-ea92-424e-b2b8-892442b41c31 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:25 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-511dba60-ea92-424e-b2b8-892442b41c31 1073741824 Jul 23 22:32:25 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Flow 'volume_create_manager' (fbffb967-478c-4bd9-8687-8904a273524b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3763e860-ca7f-46e3-a9d1-f61666cc26bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:26 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:32:26 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3763e860-ca7f-46e3-a9d1-f61666cc26bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-355800635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f765e614a62145fa8f8882b1dd662321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:32:26Z,use_quota=True,user_id='045d7c33a6a1460a95b7086ba6b2f473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f85f8e4-b3b6-4d8d-8552-a51e612ab473),volume_type_id=4f85f8e4-b3b6-4d8d-8552-a51e612ab473)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143674cf-e1f2-4d1c-9e98-c38596646a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143674cf-e1f2-4d1c-9e98-c38596646a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89aef6f-fb47-40c2-864d-dbec95eb4f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89aef6f-fb47-40c2-864d-dbec95eb4f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11', 'volume_name': 'volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba61b91-aaf2-413b-824c-3981151b32c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba61b91-aaf2-413b-824c-3981151b32c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57242316-0103-497d-9dd8-78ce82e94376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:26 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Volume f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11', 'volume_size': 1} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:32:26 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-511dba60-ea92-424e-b2b8-892442b41c31 1073741824" returned: 0 in 0.986s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-511dba60-ea92-424e-b2b8-892442b41c31 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:26 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.534s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:32:26 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-511dba60-ea92-424e-b2b8-892442b41c31 Jul 23 22:32:26 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 29 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:32:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:32:27 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-511dba60-ea92-424e-b2b8-892442b41c31" returned: 0 in 0.631s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.903s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-355800635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f765e614a62145fa8f8882b1dd662321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:32:26Z,use_quota=True,user_id='045d7c33a6a1460a95b7086ba6b2f473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f85f8e4-b3b6-4d8d-8552-a51e612ab473),volume_type_id=4f85f8e4-b3b6-4d8d-8552-a51e612ab473)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Creating volume f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:32:27 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797332a0-8c52-445c-a9b1-cdfc9955aa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-511dba60-ea92-424e-b2b8-892442b41c31', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a33af2-27df-4384-8e56-a41f77314e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:27 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11 1073741824 Jul 23 22:32:27 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:27 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Volume volume-511dba60-ea92-424e-b2b8-892442b41c31 (511dba60-ea92-424e-b2b8-892442b41c31): created successfully Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a33af2-27df-4384-8e56-a41f77314e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Flow 'volume_create_manager' (8b629278-7a1d-448d-8833-e8bc15fa9d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Flow 'volume_create_manager' (d3615743-dfc9-48ab-b79c-f577569caae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8119de42-b3fa-4fdd-9da4-912659c875c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:27 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ab354dba-0b95-450f-9c39-cc5113f40165 tempest-TestInstancesWithCinderVolumes-463132486 None] Created volume successfully. Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8119de42-b3fa-4fdd-9da4-912659c875c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-456060278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e48575c-0b19-45bd-97ab-a5a24baa85bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f765e614a62145fa8f8882b1dd662321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:32:27Z,use_quota=True,user_id='045d7c33a6a1460a95b7086ba6b2f473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45ca18b0-752b-4fd1-b898-5f802a6829b3),volume_type_id=45ca18b0-752b-4fd1-b898-5f802a6829b3)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c145085-f00a-4e5d-8f64-683a0bb582d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c145085-f00a-4e5d-8f64-683a0bb582d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c294fac-7cb0-40c3-bcec-bbe048a14723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.image.glance [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Creating Keystone auth plugin from conf {{(pid=88308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c294fac-7cb0-40c3-bcec-bbe048a14723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0e48575c-0b19-45bd-97ab-a5a24baa85bc', 'volume_name': 'volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc', 'volume_size': 1, 'image_id': 'd354a136-fe0c-4f14-8c75-567ad9f70a89', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d354a136-fe0c-4f14-8c75-567ad9f70a89', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2076281654', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f765e614a62145fa8f8882b1dd662321', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd354a136-fe0c-4f14-8c75-567ad9f70a89', 'created_at': datetime.datetime(2026, 7, 23, 20, 32, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 32, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d354a136-fe0c-4f14-8c75-567ad9f70a89/file', 'properties': {}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0083535d-486c-4899-b700-d740e890605e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0083535d-486c-4899-b700-d740e890605e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89527a16-aedb-4c6b-b770-7359ee4a5467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:28 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Volume 0e48575c-0b19-45bd-97ab-a5a24baa85bc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc', 'volume_size': 1, 'image_id': 'd354a136-fe0c-4f14-8c75-567ad9f70a89', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d354a136-fe0c-4f14-8c75-567ad9f70a89', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2076281654', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f765e614a62145fa8f8882b1dd662321', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd354a136-fe0c-4f14-8c75-567ad9f70a89', 'created_at': datetime.datetime(2026, 7, 23, 20, 32, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 32, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d354a136-fe0c-4f14-8c75-567ad9f70a89/file', 'properties': {}}, 'image_service': } Jul 23 22:32:28 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Trying to clone 0e48575c-0b19-45bd-97ab-a5a24baa85bc from image d354a136-fe0c-4f14-8c75-567ad9f70a89 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d354a136-fe0c-4f14-8c75-567ad9f70a89', 'metadata': {}}]). {{(pid=88308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 22:32:28 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11 1073741824" returned: 0 in 1.018s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:28 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11 Jul 23 22:32:28 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:28 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11" returned: 0 in 0.441s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:28 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:32:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:32:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57242316-0103-497d-9dd8-78ce82e94376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55832e06-fa27-4fa6-88dd-a1f09a3df0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:28 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Volume volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11 (f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11): created successfully Jul 23 22:32:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55832e06-fa27-4fa6-88dd-a1f09a3df0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Flow 'volume_create_manager' (fbffb967-478c-4bd9-8687-8904a273524b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:32:28 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f72cfa95-bed3-4ba8-81d7-556ed914f7ef tempest-TestInstancesWithCinderVolumes-463132486 None] Created volume successfully. Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Flow 'volume_create_manager' (f95e9ba8-9336-427c-bcf4-2382087de4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a2dbd1-98e0-48e8-8a20-91578172a881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a2dbd1-98e0-48e8-8a20-91578172a881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1186685686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32578acb-7e1a-439c-aff1-8195b83306d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c402a1f0add648d59088f3447fc35a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:32:32Z,use_quota=True,user_id='a5579b9598fe412cac5e77db8fb530de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be142804-74ff-4cf5-b6e3-db8d9ad9eac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be142804-74ff-4cf5-b6e3-db8d9ad9eac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a6d038-da55-40b9-b94f-e9b60270715f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a6d038-da55-40b9-b94f-e9b60270715f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32578acb-7e1a-439c-aff1-8195b83306d1', 'volume_name': 'volume-32578acb-7e1a-439c-aff1-8195b83306d1', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ef3ce5-1435-4403-b623-51ff310f69bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ef3ce5-1435-4403-b623-51ff310f69bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abad63f5-f534-45c5-8ba0-fc8139ce37cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:32 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Volume 32578acb-7e1a-439c-aff1-8195b83306d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32578acb-7e1a-439c-aff1-8195b83306d1', 'volume_size': 1} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1186685686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32578acb-7e1a-439c-aff1-8195b83306d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c402a1f0add648d59088f3447fc35a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:32:32Z,use_quota=True,user_id='a5579b9598fe412cac5e77db8fb530de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Creating volume 32578acb-7e1a-439c-aff1-8195b83306d1 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:32:32 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:32 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 1073741824 Jul 23 22:32:32 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d354a136-fe0c-4f14-8c75-567ad9f70a89_z5fhukzsdevstack@QuobyteHD, size 20.69 MB, duration 4.33 sec {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 22:32:32 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Image download 20.69 MB at 4.77 MB/s Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c5a29d-daf0-4ee9-a9ce-af46e42d371a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d354a136-fe0c-4f14-8c75-567ad9f70a89_z5fhukzsdevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:32 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d354a136-fe0c-4f14-8c75-567ad9f70a89_z5fhukzsdevstack@QuobyteHD Jul 23 22:32:32 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:32 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d354a136-fe0c-4f14-8c75-567ad9f70a89_z5fhukzsdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Temporary image d354a136-fe0c-4f14-8c75-567ad9f70a89 is fetched for user 045d7c33a6a1460a95b7086ba6b2f473. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 22:32:32 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 1073741824" returned: 0 in 0.557s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[438b46c2-126b-4128-8a17-70d6aa21b8ca]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d354a136-fe0c-4f14-8c75-567ad9f70a89_z5fhukzsdevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:32 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 Jul 23 22:32:32 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:33 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d354a136-fe0c-4f14-8c75-567ad9f70a89_z5fhukzsdevstack@QuobyteHD Jul 23 22:32:33 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:33 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1" returned: 0 in 0.325s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abad63f5-f534-45c5-8ba0-fc8139ce37cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32578acb-7e1a-439c-aff1-8195b83306d1', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81283110-d336-4698-9ff2-a8c1d729412a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:33 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Volume volume-32578acb-7e1a-439c-aff1-8195b83306d1 (32578acb-7e1a-439c-aff1-8195b83306d1): created successfully Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81283110-d336-4698-9ff2-a8c1d729412a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Flow 'volume_create_manager' (f95e9ba8-9336-427c-bcf4-2382087de4a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:32:33 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:33 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-29ec8fdb-2ba3-416e-839e-3614a2112b75 tempest-TestStampPattern-1900735528 None] Created volume successfully. Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d354a136-fe0c-4f14-8c75-567ad9f70a89_z5fhukzsdevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-456060278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e48575c-0b19-45bd-97ab-a5a24baa85bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f765e614a62145fa8f8882b1dd662321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:32:27Z,use_quota=True,user_id='045d7c33a6a1460a95b7086ba6b2f473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45ca18b0-752b-4fd1-b898-5f802a6829b3),volume_type_id=45ca18b0-752b-4fd1-b898-5f802a6829b3)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Creating volume 0e48575c-0b19-45bd-97ab-a5a24baa85bc {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:32:33 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:33 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc 1073741824 Jul 23 22:32:33 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:33 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc 1073741824" returned: 0 in 0.502s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:33 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc Jul 23 22:32:33 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:34 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc" returned: 0 in 0.270s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:32:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:32:34 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Attempting download of d354a136-fe0c-4f14-8c75-567ad9f70a89 ((None, [{'url': 'file:///opt/stack/data/glance/images/d354a136-fe0c-4f14-8c75-567ad9f70a89', 'metadata': {}}])) to volume 0e48575c-0b19-45bd-97ab-a5a24baa85bc. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 22:32:34 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2131c46a-ae85-4ee0-b458-38db05ed8858]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:32:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d354a136-fe0c-4f14-8c75-567ad9f70a89_l57bvez1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:34 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d354a136-fe0c-4f14-8c75-567ad9f70a89_l57bvez1 Jul 23 22:32:34 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:34 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d354a136-fe0c-4f14-8c75-567ad9f70a89_l57bvez1" returned: 0 in 0.473s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d354a136-fe0c-4f14-8c75-567ad9f70a89_l57bvez1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:34 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d354a136-fe0c-4f14-8c75-567ad9f70a89_l57bvez1 Jul 23 22:32:34 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:35 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d354a136-fe0c-4f14-8c75-567ad9f70a89_l57bvez1" returned: 1 in 0.521s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d354a136-fe0c-4f14-8c75-567ad9f70a89_l57bvez1' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:32:35 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c32607a-f51d-4b29-8d56-db4efeef7490]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:32:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d354a136-fe0c-4f14-8c75-567ad9f70a89_z5fhukzsdevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:35 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d354a136-fe0c-4f14-8c75-567ad9f70a89_z5fhukzsdevstack@QuobyteHD Jul 23 22:32:35 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:35 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d354a136-fe0c-4f14-8c75-567ad9f70a89_z5fhukzsdevstack@QuobyteHD" returned: 0 in 0.540s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:35 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] d354a136-fe0c-4f14-8c75-567ad9f70a89 was qcow2, converting to raw {{(pid=88308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 22:32:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d354a136-fe0c-4f14-8c75-567ad9f70a89_z5fhukzsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:35 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d354a136-fe0c-4f14-8c75-567ad9f70a89_z5fhukzsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc Jul 23 22:32:35 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d354a136-fe0c-4f14-8c75-567ad9f70a89_z5fhukzsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc" returned: 0 in 1.793s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:37 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d354a136-fe0c-4f14-8c75-567ad9f70a89_z5fhukzsdevstack@QuobyteHD, size 112.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:32:37 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Converted 112.00 MB image at 62.42 MB/s Jul 23 22:32:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:37 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:37 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc 1G Jul 23 22:32:37 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:38 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc 1G" returned: 0 in 0.729s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:38 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f2bf45-7243-4217-8b17-6a5bc345586e]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:32:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:38 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc Jul 23 22:32:38 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:39 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc" returned: 0 in 0.728s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:39 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc Jul 23 22:32:39 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:39 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc" returned: 1 in 0.416s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:32:39 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Downloaded image d354a136-fe0c-4f14-8c75-567ad9f70a89 ((None, [{'url': 'file:///opt/stack/data/glance/images/d354a136-fe0c-4f14-8c75-567ad9f70a89', 'metadata': {}}])) to volume 0e48575c-0b19-45bd-97ab-a5a24baa85bc successfully. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 22:32:39 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Temporary image d354a136-fe0c-4f14-8c75-567ad9f70a89 for user 045d7c33a6a1460a95b7086ba6b2f473 is deleted. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 22:32:39 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Marking volume 0e48575c-0b19-45bd-97ab-a5a24baa85bc as bootable. {{(pid=88308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 22:32:39 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Copying metadata from image d354a136-fe0c-4f14-8c75-567ad9f70a89 to 0e48575c-0b19-45bd-97ab-a5a24baa85bc. {{(pid=88308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 22:32:39 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Creating volume glance metadata for volume 0e48575c-0b19-45bd-97ab-a5a24baa85bc backed by image d354a136-fe0c-4f14-8c75-567ad9f70a89 with: {'image_id': 'd354a136-fe0c-4f14-8c75-567ad9f70a89', 'image_name': 'tempest-scenario-img--2076281654', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 22:32:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89527a16-aedb-4c6b-b770-7359ee4a5467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc', 'volume_size': 1, 'image_id': 'd354a136-fe0c-4f14-8c75-567ad9f70a89', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d354a136-fe0c-4f14-8c75-567ad9f70a89', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2076281654', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f765e614a62145fa8f8882b1dd662321', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd354a136-fe0c-4f14-8c75-567ad9f70a89', 'created_at': datetime.datetime(2026, 7, 23, 20, 32, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 32, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d354a136-fe0c-4f14-8c75-567ad9f70a89/file', 'properties': {}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9199f1f-939b-4bab-8185-b8cbb7f73cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:32:39 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Volume volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc (0e48575c-0b19-45bd-97ab-a5a24baa85bc): created successfully Jul 23 22:32:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9199f1f-939b-4bab-8185-b8cbb7f73cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:32:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Flow 'volume_create_manager' (d3615743-dfc9-48ab-b79c-f577569caae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:32:39 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-276dfda8-cc01-4f4b-bf60-631d9564ccec tempest-TestInstancesWithCinderVolumes-463132486 None] Created volume successfully. Jul 23 22:32:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-05c78951-13db-46c8-874f-1d018279e1ff req-3e60668a-c144-4a72-8706-b182ca5058f0 tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:32:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-05c78951-13db-46c8-874f-1d018279e1ff req-3e60668a-c144-4a72-8706-b182ca5058f0 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:32:43 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab69670b-0e99-4ea4-8175-8e15f7980a6a]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:32:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-05c78951-13db-46c8-874f-1d018279e1ff req-3e60668a-c144-4a72-8706-b182ca5058f0 tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:43 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc Jul 23 22:32:44 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:44 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-05c78951-13db-46c8-874f-1d018279e1ff req-3e60668a-c144-4a72-8706-b182ca5058f0 tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc" returned: 0 in 0.489s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-05c78951-13db-46c8-874f-1d018279e1ff req-3e60668a-c144-4a72-8706-b182ca5058f0 tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:44 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc Jul 23 22:32:44 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:44 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-05c78951-13db-46c8-874f-1d018279e1ff req-3e60668a-c144-4a72-8706-b182ca5058f0 tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc" returned: 1 in 0.520s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-05c78951-13db-46c8-874f-1d018279e1ff req-3e60668a-c144-4a72-8706-b182ca5058f0 tempest-TestInstancesWithCinderVolumes-463132486 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:32:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-05c78951-13db-46c8-874f-1d018279e1ff req-3e60668a-c144-4a72-8706-b182ca5058f0 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.076s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:32:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-05c78951-13db-46c8-874f-1d018279e1ff req-3e60668a-c144-4a72-8706-b182ca5058f0 tempest-TestInstancesWithCinderVolumes-463132486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '831c9163-4360-4327-a76e-5fae5e6fcdbd', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:32:44 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-05c78951-13db-46c8-874f-1d018279e1ff req-3e60668a-c144-4a72-8706-b182ca5058f0 tempest-TestInstancesWithCinderVolumes-463132486 None] attachment_update completed successfully. Jul 23 22:32:54 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:UPDATE=18,cinder:SELECT=17,cinder:DELETE=3,cinder:INSERT=8 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:32:54 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=21,cinder:UPDATE=12,cinder:INSERT=5,cinder:DELETE=1 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:32:56 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-7cd655c5-f52e-4a16-bc9b-ce1f1c038de5 req-84b30088-d88a-40b2-ab79-deb538829192 tempest-TestShelveInstance-1157895983 None] Terminate volume connection completed successfully. Jul 23 22:32:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-7cd655c5-f52e-4a16-bc9b-ce1f1c038de5 req-84b30088-d88a-40b2-ab79-deb538829192 tempest-TestShelveInstance-1157895983 None] Deleting attachment 00fae1c1-b48a-4848-be18-18ed8d935c53. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:32:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-acc119f9-7297-4ed7-baaa-ee7762bbd3d1 req-55843aa7-5beb-4de8-a861-8a6f9f9957f2 tempest-TestShelveInstance-1157895983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:32:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-acc119f9-7297-4ed7-baaa-ee7762bbd3d1 req-55843aa7-5beb-4de8-a861-8a6f9f9957f2 tempest-TestShelveInstance-1157895983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:32:58 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b4add9-13bf-40ec-ade5-72d37fd24a08]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:32:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-acc119f9-7297-4ed7-baaa-ee7762bbd3d1 req-55843aa7-5beb-4de8-a861-8a6f9f9957f2 tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:58 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 Jul 23 22:32:58 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:58 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-acc119f9-7297-4ed7-baaa-ee7762bbd3d1 req-55843aa7-5beb-4de8-a861-8a6f9f9957f2 tempest-TestShelveInstance-1157895983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2" returned: 0 in 0.376s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-acc119f9-7297-4ed7-baaa-ee7762bbd3d1 req-55843aa7-5beb-4de8-a861-8a6f9f9957f2 tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:32:59 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 Jul 23 22:32:59 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:32:59 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Jul 23 22:32:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-acc119f9-7297-4ed7-baaa-ee7762bbd3d1 req-55843aa7-5beb-4de8-a861-8a6f9f9957f2 tempest-TestShelveInstance-1157895983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2" returned: 1 in 0.363s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:32:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-acc119f9-7297-4ed7-baaa-ee7762bbd3d1 req-55843aa7-5beb-4de8-a861-8a6f9f9957f2 tempest-TestShelveInstance-1157895983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:32:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-acc119f9-7297-4ed7-baaa-ee7762bbd3d1 req-55843aa7-5beb-4de8-a861-8a6f9f9957f2 tempest-TestShelveInstance-1157895983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.781s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:32:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-acc119f9-7297-4ed7-baaa-ee7762bbd3d1 req-55843aa7-5beb-4de8-a861-8a6f9f9957f2 tempest-TestShelveInstance-1157895983 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c9bbf0c-573a-4a11-bb7f-cf274b0ba838', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:32:59 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-acc119f9-7297-4ed7-baaa-ee7762bbd3d1 req-55843aa7-5beb-4de8-a861-8a6f9f9957f2 tempest-TestShelveInstance-1157895983 None] attachment_update completed successfully. Jul 23 22:33:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-162e1787-511e-4a13-8c5b-978067d8cf1f req-0d481715-6f4f-49ef-a98a-320be1ad980a tempest-TestStampPattern-1900735528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:33:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-162e1787-511e-4a13-8c5b-978067d8cf1f req-0d481715-6f4f-49ef-a98a-320be1ad980a tempest-TestStampPattern-1900735528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:33:05 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0798e2-c5f4-4be9-aa64-7755db99ae41]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:33:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-162e1787-511e-4a13-8c5b-978067d8cf1f req-0d481715-6f4f-49ef-a98a-320be1ad980a tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:05 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 Jul 23 22:33:05 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:06 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-162e1787-511e-4a13-8c5b-978067d8cf1f req-0d481715-6f4f-49ef-a98a-320be1ad980a tempest-TestStampPattern-1900735528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1" returned: 0 in 0.455s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-162e1787-511e-4a13-8c5b-978067d8cf1f req-0d481715-6f4f-49ef-a98a-320be1ad980a tempest-TestStampPattern-1900735528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.484s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:33:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-162e1787-511e-4a13-8c5b-978067d8cf1f req-0d481715-6f4f-49ef-a98a-320be1ad980a tempest-TestStampPattern-1900735528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-32578acb-7e1a-439c-aff1-8195b83306d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61763d6a-8f96-4a8a-94a2-6bf6a298147d', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:33:06 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-162e1787-511e-4a13-8c5b-978067d8cf1f req-0d481715-6f4f-49ef-a98a-320be1ad980a tempest-TestStampPattern-1900735528 None] attachment_update completed successfully. Jul 23 22:33:10 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-e2e1031a-57a7-42b4-9083-06619e0aed19 req-1dab5f08-985f-4283-9c27-1de58fb23238 tempest-TestStampPattern-1900735528 None] Terminate volume connection completed successfully. Jul 23 22:33:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-e2e1031a-57a7-42b4-9083-06619e0aed19 req-1dab5f08-985f-4283-9c27-1de58fb23238 tempest-TestStampPattern-1900735528 None] Deleting attachment 61763d6a-8f96-4a8a-94a2-6bf6a298147d. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:33:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:33:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:33:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] Creating offline snapshot d3a3f3be-3229-46cc-936f-c6acf3edc63a of volume 32578acb-7e1a-439c-aff1-8195b83306d1 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:33:11 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3c8e49-5de7-49fe-8029-be2bfcc7a8d5]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:33:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:11 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 Jul 23 22:33:11 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:12 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1" returned: 0 in 0.385s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:12 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a 1G Jul 23 22:33:12 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:12 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a 1G" returned: 0 in 0.459s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32578acb-7e1a-439c-aff1-8195b83306d1 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:12 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32578acb-7e1a-439c-aff1-8195b83306d1 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a Jul 23 22:33:12 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:12 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32578acb-7e1a-439c-aff1-8195b83306d1 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a" returned: 0 in 0.445s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:12 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a is being set with open permissions: ugo+rw Jul 23 22:33:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:13 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a Jul 23 22:33:13 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:13 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a" returned: 0 in 0.313s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:13 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.info Jul 23 22:33:13 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:13 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.info" returned: 0 in 0.316s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:13 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.info is being set with open permissions: ugo+rw Jul 23 22:33:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:13 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.info Jul 23 22:33:13 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:13 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.info" returned: 0 in 0.269s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.303s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:33:13 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-08799c18-919e-435e-9234-2638a6c24b2c tempest-TestStampPattern-1900735528 None] Create snapshot completed successfully Jul 23 22:33:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-1bb81d66-e77d-4f98-9a37-74ccbf48ee1f req-ab359a4b-d883-407a-a84f-5c55cdded0eb tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:33:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-1bb81d66-e77d-4f98-9a37-74ccbf48ee1f req-ab359a4b-d883-407a-a84f-5c55cdded0eb tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:33:18 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8592bb0-0458-48ee-91c0-c8bd3c093e97]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:33:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-1bb81d66-e77d-4f98-9a37-74ccbf48ee1f req-ab359a4b-d883-407a-a84f-5c55cdded0eb tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-511dba60-ea92-424e-b2b8-892442b41c31 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:18 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-511dba60-ea92-424e-b2b8-892442b41c31 Jul 23 22:33:18 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:19 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-1bb81d66-e77d-4f98-9a37-74ccbf48ee1f req-ab359a4b-d883-407a-a84f-5c55cdded0eb tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-511dba60-ea92-424e-b2b8-892442b41c31" returned: 0 in 0.424s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-1bb81d66-e77d-4f98-9a37-74ccbf48ee1f req-ab359a4b-d883-407a-a84f-5c55cdded0eb tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.457s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:33:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-1bb81d66-e77d-4f98-9a37-74ccbf48ee1f req-ab359a4b-d883-407a-a84f-5c55cdded0eb tempest-TestInstancesWithCinderVolumes-463132486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-511dba60-ea92-424e-b2b8-892442b41c31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46f6e7ce-9781-4126-8def-3f2c03718c60', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:33:19 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-1bb81d66-e77d-4f98-9a37-74ccbf48ee1f req-ab359a4b-d883-407a-a84f-5c55cdded0eb tempest-TestInstancesWithCinderVolumes-463132486 None] attachment_update completed successfully. Jul 23 22:33:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-42441114-f448-44dd-85c9-36805da99557 req-92d92705-a87f-4126-bfcf-323b506d100e tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:33:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-42441114-f448-44dd-85c9-36805da99557 req-92d92705-a87f-4126-bfcf-323b506d100e tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:33:21 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[72817cbc-5364-4faa-a627-57de62827e83]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:33:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-42441114-f448-44dd-85c9-36805da99557 req-92d92705-a87f-4126-bfcf-323b506d100e tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:21 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11 Jul 23 22:33:21 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:21 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-42441114-f448-44dd-85c9-36805da99557 req-92d92705-a87f-4126-bfcf-323b506d100e tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11" returned: 0 in 0.364s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-42441114-f448-44dd-85c9-36805da99557 req-92d92705-a87f-4126-bfcf-323b506d100e tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.381s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-42441114-f448-44dd-85c9-36805da99557 req-92d92705-a87f-4126-bfcf-323b506d100e tempest-TestInstancesWithCinderVolumes-463132486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f1cb159-b9a7-4d1d-83ba-fec6e350b089', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:33:22 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-42441114-f448-44dd-85c9-36805da99557 req-92d92705-a87f-4126-bfcf-323b506d100e tempest-TestInstancesWithCinderVolumes-463132486 None] attachment_update completed successfully. Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Flow 'volume_create_manager' (e65eb8e0-11e7-442b-85e1-d8c74aee7c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa63b0d7-35c6-4719-927e-cbfce58276bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa63b0d7-35c6-4719-927e-cbfce58276bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-677199732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0992e5-3035-4e93-b8ea-f795ecc4ab38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c402a1f0add648d59088f3447fc35a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d3a3f3be-3229-46cc-936f-c6acf3edc63a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:33:23Z,use_quota=True,user_id='a5579b9598fe412cac5e77db8fb530de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69159120-f8e7-4dff-bee7-00413020d802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69159120-f8e7-4dff-bee7-00413020d802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4219e077-978a-41be-bae4-6795bdf38192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4219e077-978a-41be-bae4-6795bdf38192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc0992e5-3035-4e93-b8ea-f795ecc4ab38', 'volume_name': 'volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38', 'volume_size': 1, 'snapshot_id': 'd3a3f3be-3229-46cc-936f-c6acf3edc63a'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647a5719-8a79-4c8b-b4be-106651b8eef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647a5719-8a79-4c8b-b4be-106651b8eef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712a364f-ff81-47b1-b087-8ff258a47e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:33:22 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Volume dc0992e5-3035-4e93-b8ea-f795ecc4ab38: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38', 'volume_size': 1, 'snapshot_id': 'd3a3f3be-3229-46cc-936f-c6acf3edc63a'} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Acquiring lock "cinder-quobyte-d3a3f3be-3229-46cc-936f-c6acf3edc63a-dc0992e5-3035-4e93-b8ea-f795ecc4ab38" by "_create_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Lock "cinder-quobyte-d3a3f3be-3229-46cc-936f-c6acf3edc63a-dc0992e5-3035-4e93-b8ea-f795ecc4ab38" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Creating volume dc0992e5-3035-4e93-b8ea-f795ecc4ab38 from snapshot d3a3f3be-3229-46cc-936f-c6acf3edc63a {{(pid=88308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Acquiring lock "cinder-quobyte-dc0992e5-3035-4e93-b8ea-f795ecc4ab38" by "_copy_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Lock "cinder-quobyte-dc0992e5-3035-4e93-b8ea-f795ecc4ab38" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] snapshot: d3a3f3be-3229-46cc-936f-c6acf3edc63a, volume: dc0992e5-3035-4e93-b8ea-f795ecc4ab38, {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6410e3fd-657f-471d-9e84-7cd5ef8995dc]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:33:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:23 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a Jul 23 22:33:23 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:23 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a" returned: 0 in 0.387s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32578acb-7e1a-439c-aff1-8195b83306d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:33:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 23 22:33:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Creating direct copy from snapshot {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 23 22:33:23 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8350d8ac-53e2-4204-b30a-bbd2eed439ef]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:33:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:23 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 Jul 23 22:33:23 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:23 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1" returned: 0 in 0.399s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:23 devstack cinder-volume[88308]: DEBUG cinder.utils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Path /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38 not found in is_blk_device check {{(pid=88308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 22:33:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:23 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38 Jul 23 22:33:23 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:33:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:33:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:33:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:33:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:33:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:33:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:26 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:33:26 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:27 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.941s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:27 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:33:27 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:33:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 29 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:33:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:33:30 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38" returned: 0 in 6.973s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:30 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2dea24-6473-46cf-9e9c-fc092fed2a1a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:33:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:30 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 Jul 23 22:33:30 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:31 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-ff56b63b-8dcb-4901-adcb-239a48c342bc req-2b64e3e5-20aa-4de3-aed7-44f1a4d086e0 tempest-TestInstancesWithCinderVolumes-463132486 None] Terminate volume connection completed successfully. Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-ff56b63b-8dcb-4901-adcb-239a48c342bc req-2b64e3e5-20aa-4de3-aed7-44f1a4d086e0 tempest-TestInstancesWithCinderVolumes-463132486 None] Deleting attachment 46f6e7ce-9781-4126-8def-3f2c03718c60. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:33:31 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1" returned: 0 in 0.766s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1, size 1024.00 MB, duration 6.97 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38 {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:33:31 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Converted 1024.00 MB image at 146.83 MB/s Jul 23 22:33:31 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38 is being set with open permissions: ugo+rw Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:31 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38 Jul 23 22:33:31 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "cinder-511dba60-ea92-424e-b2b8-892442b41c31-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "cinder-511dba60-ea92-424e-b2b8-892442b41c31-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "cinder-quobyte-511dba60-ea92-424e-b2b8-892442b41c31" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "cinder-quobyte-511dba60-ea92-424e-b2b8-892442b41c31" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f545468-7e13-48a5-97d3-0fddf00c8da6]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-511dba60-ea92-424e-b2b8-892442b41c31 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:31 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38" returned: 0 in 0.312s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Lock "cinder-quobyte-dc0992e5-3035-4e93-b8ea-f795ecc4ab38" released by "_copy_volume_from_snapshot" :: held 8.970s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Lock "cinder-quobyte-d3a3f3be-3229-46cc-936f-c6acf3edc63a-dc0992e5-3035-4e93-b8ea-f795ecc4ab38" released by "_create_volume_from_snapshot" :: held 9.006s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.025s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712a364f-ff81-47b1-b087-8ff258a47e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38', 'volume_size': 1, 'snapshot_id': 'd3a3f3be-3229-46cc-936f-c6acf3edc63a'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37b73f8-8cf5-428d-a4b3-38391447159f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:33:31 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Volume volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38 (dc0992e5-3035-4e93-b8ea-f795ecc4ab38): created successfully Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37b73f8-8cf5-428d-a4b3-38391447159f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:33:31 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-511dba60-ea92-424e-b2b8-892442b41c31 Jul 23 22:33:31 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Flow 'volume_create_manager' (e65eb8e0-11e7-442b-85e1-d8c74aee7c2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:33:31 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c5b9696a-527f-440f-b41c-4cf21716f518 tempest-TestStampPattern-1900735528 None] Created volume successfully. Jul 23 22:33:32 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-511dba60-ea92-424e-b2b8-892442b41c31" returned: 0 in 0.582s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-511dba60-ea92-424e-b2b8-892442b41c31 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:32 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-511dba60-ea92-424e-b2b8-892442b41c31 Jul 23 22:33:32 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:32 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-511dba60-ea92-424e-b2b8-892442b41c31" returned: 0 in 0.456s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:32 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "cinder-quobyte-511dba60-ea92-424e-b2b8-892442b41c31" released by "delete_volume" :: held 1.096s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:33:32 devstack cinder-volume[88308]: WARNING cinder.quota [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-787804058-426668728 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-787804058-426668728, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:33:32 devstack cinder-volume[88308]: WARNING cinder.quota [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-787804058-426668728 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-787804058-426668728, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:33:32 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Created reservations ['bbe46dbe-ceb5-47ed-be06-28a81c089066', '42b9e88d-5538-4b76-8255-0490d9af3efe', '39255a16-f03c-4322-8637-8edb85ec1c11', '5b96b382-da3d-4c6e-b2e2-9ca8ef63d0ce'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:33:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:33:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:33:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:33:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:33:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:33:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:33 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:33:33 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:33 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.303s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:33 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:33:33 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Deleted volume successfully. Jul 23 22:33:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-78f0c271-6eed-4b63-bb1e-2a027fa9d374 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "cinder-511dba60-ea92-424e-b2b8-892442b41c31-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:33:36 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-97e9c931-9e06-4a68-8aeb-4052a6cabd5a req-9dc0eb5f-d115-4b8e-8ef7-21e8412c7574 tempest-TestInstancesWithCinderVolumes-463132486 None] Terminate volume connection completed successfully. Jul 23 22:33:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-97e9c931-9e06-4a68-8aeb-4052a6cabd5a req-9dc0eb5f-d115-4b8e-8ef7-21e8412c7574 tempest-TestInstancesWithCinderVolumes-463132486 None] Deleting attachment 8f1cb159-b9a7-4d1d-83ba-fec6e350b089. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:33:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "cinder-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:33:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "cinder-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:33:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "cinder-quobyte-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:33:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "cinder-quobyte-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11" acquired by "delete_volume" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:33:36 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e09de4b-217c-4fa7-8d7b-2a07ce351a4d]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:33:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:36 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11 Jul 23 22:33:36 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:37 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11" returned: 0 in 0.518s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:37 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11 Jul 23 22:33:37 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:37 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11" returned: 0 in 0.354s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "cinder-quobyte-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11" released by "delete_volume" :: held 0.938s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:33:37 devstack cinder-volume[88308]: WARNING cinder.quota [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-499935394-259421800 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-499935394-259421800, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:33:37 devstack cinder-volume[88308]: WARNING cinder.quota [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-499935394-259421800 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-499935394-259421800, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:33:37 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Created reservations ['fcbbce72-1c85-4c44-abf0-38af293d5bad', 'ac534908-64e5-404b-81d6-744b5086a3c2', 'ba4eab39-2c38-4b04-9b35-19d9dad588a9', '7862f69d-c648-4de9-a73f-19e94e49cde3'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:33:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:33:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:33:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:33:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:33:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:33:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:37 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:33:37 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:38 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.520s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:38 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:33:38 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Deleted volume successfully. Jul 23 22:33:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-032ff08b-c1de-4027-9bcc-ded6e9c74030 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "cinder-f2d20fb3-a9cb-4616-b6fd-1b8bd0dd0a11-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:33:41 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-f4899fb8-e037-460e-be47-25fb97054d16 req-14b22b84-9673-49e5-9bc1-4a3153c4c18c tempest-TestInstancesWithCinderVolumes-463132486 None] Terminate volume connection completed successfully. Jul 23 22:33:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-f4899fb8-e037-460e-be47-25fb97054d16 req-14b22b84-9673-49e5-9bc1-4a3153c4c18c tempest-TestInstancesWithCinderVolumes-463132486 None] Deleting attachment 831c9163-4360-4327-a76e-5fae5e6fcdbd. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:33:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "cinder-0e48575c-0b19-45bd-97ab-a5a24baa85bc-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:33:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "cinder-0e48575c-0b19-45bd-97ab-a5a24baa85bc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:33:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "cinder-quobyte-0e48575c-0b19-45bd-97ab-a5a24baa85bc" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:33:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "cinder-quobyte-0e48575c-0b19-45bd-97ab-a5a24baa85bc" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:33:42 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfebc581-233d-4b1e-a9e6-98da6c1bf928]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:33:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:42 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc Jul 23 22:33:42 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:43 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc" returned: 0 in 0.640s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:43 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc Jul 23 22:33:43 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:44 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc" returned: 1 in 0.811s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:33:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:44 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc Jul 23 22:33:44 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:44 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0e48575c-0b19-45bd-97ab-a5a24baa85bc" returned: 0 in 0.276s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "cinder-quobyte-0e48575c-0b19-45bd-97ab-a5a24baa85bc" released by "delete_volume" :: held 1.804s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:33:44 devstack cinder-volume[88308]: WARNING cinder.quota [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1430531844-1399769263 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1430531844-1399769263, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:33:44 devstack cinder-volume[88308]: WARNING cinder.quota [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1430531844-1399769263 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1430531844-1399769263, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:33:44 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Created reservations ['16741ed4-ab4a-4ae5-95b6-39f5a6fe1c77', '87f55e1b-0ae2-48ab-9c18-8399fc5e3ed2', 'bba7c00a-851f-499c-8bc2-804503c3300b', '79c74592-9f17-4f95-9f31-d2e4a41aee15'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:33:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:33:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:33:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:33:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:33:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:33:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:44 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:33:44 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:45 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.528s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:45 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:33:45 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Deleted volume successfully. Jul 23 22:33:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c6c096f8-3b29-4289-91a1-6ba80fab6766 tempest-TestInstancesWithCinderVolumes-463132486 None] Lock "cinder-0e48575c-0b19-45bd-97ab-a5a24baa85bc-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:33:45 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-021b93bd-b8e6-4741-9095-317202b8590d tempest-TestShelveInstance-1157895983 None] Terminate volume connection completed successfully. Jul 23 22:33:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-021b93bd-b8e6-4741-9095-317202b8590d tempest-TestShelveInstance-1157895983 None] Deleting attachment 6c9bbf0c-573a-4a11-bb7f-cf274b0ba838. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:33:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Acquiring lock "cinder-d046d3ef-9f42-4a36-98be-ae663c2aa8b2-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:33:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Lock "cinder-d046d3ef-9f42-4a36-98be-ae663c2aa8b2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:33:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Acquiring lock "cinder-quobyte-d046d3ef-9f42-4a36-98be-ae663c2aa8b2" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:33:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Lock "cinder-quobyte-d046d3ef-9f42-4a36-98be-ae663c2aa8b2" acquired by "delete_volume" :: waited 0.029s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:33:45 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3771b62-fd02-419b-bcbf-2db08d39cb42]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:33:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:45 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 Jul 23 22:33:45 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:46 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2" returned: 0 in 0.575s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:46 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 Jul 23 22:33:46 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:46 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2" returned: 1 in 0.380s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:33:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:46 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2 Jul 23 22:33:46 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:46 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d046d3ef-9f42-4a36-98be-ae663c2aa8b2" returned: 0 in 0.266s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Lock "cinder-quobyte-d046d3ef-9f42-4a36-98be-ae663c2aa8b2" released by "delete_volume" :: held 1.317s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:33:47 devstack cinder-volume[88308]: DEBUG cinder.quota [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Created reservations ['7caf81aa-b7dc-4701-8270-053c10830021', '5d9120ef-9598-428e-b88c-e0a04387f129', '23b52e1a-7715-42aa-b360-5560b9bec315', '83cd0bdd-ded6-4b6b-a115-c63145850e89'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:33:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:33:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:33:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:33:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:33:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:33:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:33:47 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:33:47 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:33:47 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 23 22:33:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.309s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:33:47 devstack cinder-volume[88308]: DEBUG cinder.manager [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:33:47 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Deleted volume successfully. Jul 23 22:33:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [req-bc27d2cc-82c7-4db6-a0ca-0ec8f64fb47e req-bc1bfdb7-1d6e-472e-823d-59d1f45bce7a tempest-TestShelveInstance-1157895983 None] Lock "cinder-d046d3ef-9f42-4a36-98be-ae663c2aa8b2-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:33:57 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=57,cinder:UPDATE=45,cinder:INSERT=7,cinder:DELETE=1 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:33:57 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=52,cinder:UPDATE=39,cinder:INSERT=10,cinder:DELETE=5 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Flow 'volume_create_manager' (f0dfbca9-9723-4917-8ae2-27fb09706769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9dc7ed-4e6e-4ffa-a59c-d82977f55c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9dc7ed-4e6e-4ffa-a59c-d82977f55c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d6d8f1-812c-492f-91bb-957a456b2167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5cfbac39fd4acbb8b67dc8d256da01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:03Z,use_quota=True,user_id='1f464133135b4fdbb4def7bb54542a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(316b6b0c-fca2-42b7-bf7a-d42707bad978),volume_type_id=316b6b0c-fca2-42b7-bf7a-d42707bad978)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec93d08-0d06-4751-bc21-ed80d6fadfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec93d08-0d06-4751-bc21-ed80d6fadfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee206a2-4e3f-449a-81e8-3ba6d8644edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG cinder.image.glance [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Creating Keystone auth plugin from conf {{(pid=88308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee206a2-4e3f-449a-81e8-3ba6d8644edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd4d6d8f1-812c-492f-91bb-957a456b2167', 'volume_name': 'volume-d4d6d8f1-812c-492f-91bb-957a456b2167', 'volume_size': 1, 'image_id': 'f7522e81-520c-48da-a475-f854ea41cc47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7522e81-520c-48da-a475-f854ea41cc47', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '949edbd5de8c3dd1869f8a124480f565', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a5cfbac39fd4acbb8b67dc8d256da01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '92205f3533014cbce2f6060d443299e4c216f975203d30da8578b1a2fab5bf36a4f6454242998c5d2fb712d9a936d7dd493cc80923fe8eda978f65a51b41c707', 'id': 'f7522e81-520c-48da-a475-f854ea41cc47', 'created_at': datetime.datetime(2026, 7, 23, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 34, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7522e81-520c-48da-a475-f854ea41cc47/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75d8ccf-d122-43a5-b63b-0d7349a33c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75d8ccf-d122-43a5-b63b-0d7349a33c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7115c4-363d-4e4d-8cb6-7a641500f526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:03 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Volume d4d6d8f1-812c-492f-91bb-957a456b2167: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d4d6d8f1-812c-492f-91bb-957a456b2167', 'volume_size': 1, 'image_id': 'f7522e81-520c-48da-a475-f854ea41cc47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7522e81-520c-48da-a475-f854ea41cc47', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '949edbd5de8c3dd1869f8a124480f565', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a5cfbac39fd4acbb8b67dc8d256da01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '92205f3533014cbce2f6060d443299e4c216f975203d30da8578b1a2fab5bf36a4f6454242998c5d2fb712d9a936d7dd493cc80923fe8eda978f65a51b41c707', 'id': 'f7522e81-520c-48da-a475-f854ea41cc47', 'created_at': datetime.datetime(2026, 7, 23, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 34, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7522e81-520c-48da-a475-f854ea41cc47/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Trying to clone d4d6d8f1-812c-492f-91bb-957a456b2167 from image f7522e81-520c-48da-a475-f854ea41cc47 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f7522e81-520c-48da-a475-f854ea41cc47', 'metadata': {}}]). {{(pid=88308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 22:34:03 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Image download 0.00 MB at 0.00 MB/s Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f6b97a-ccc5-4e15-ae99-2b4cc4adb341]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:03 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD Jul 23 22:34:03 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:03 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:04 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD Jul 23 22:34:04 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:04 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:34:04 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Temporary image f7522e81-520c-48da-a475-f854ea41cc47 is fetched for user 1f464133135b4fdbb4def7bb54542a8f. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 22:34:04 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e444031-11cd-4ca3-a08b-0db27241444e]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:04 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD Jul 23 22:34:04 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:04 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:04 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD Jul 23 22:34:04 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:05 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:34:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:05 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d6d8f1-812c-492f-91bb-957a456b2167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5cfbac39fd4acbb8b67dc8d256da01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:03Z,use_quota=True,user_id='1f464133135b4fdbb4def7bb54542a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(316b6b0c-fca2-42b7-bf7a-d42707bad978),volume_type_id=316b6b0c-fca2-42b7-bf7a-d42707bad978)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:34:05 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Creating volume d4d6d8f1-812c-492f-91bb-957a456b2167 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:34:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:05 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:05 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:05 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:34:05 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:34:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:05 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 1073741824 Jul 23 22:34:05 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:05 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 1073741824" returned: 0 in 0.588s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:05 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 Jul 23 22:34:05 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:06 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167" returned: 0 in 0.252s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:34:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:06 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Attempting download of f7522e81-520c-48da-a475-f854ea41cc47 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7522e81-520c-48da-a475-f854ea41cc47', 'metadata': {}}])) to volume d4d6d8f1-812c-492f-91bb-957a456b2167. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 22:34:06 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c49786-43c0-48ce-952a-9e007d8e88eb]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7522e81-520c-48da-a475-f854ea41cc47_yhc7qzde {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:06 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7522e81-520c-48da-a475-f854ea41cc47_yhc7qzde Jul 23 22:34:06 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:06 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7522e81-520c-48da-a475-f854ea41cc47_yhc7qzde" returned: 0 in 0.341s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7522e81-520c-48da-a475-f854ea41cc47_yhc7qzde {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:06 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7522e81-520c-48da-a475-f854ea41cc47_yhc7qzde Jul 23 22:34:06 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:06 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7522e81-520c-48da-a475-f854ea41cc47_yhc7qzde" returned: 1 in 0.336s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7522e81-520c-48da-a475-f854ea41cc47_yhc7qzde' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:34:06 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0b0855-f636-4339-bc1f-d5c560b46d50]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:06 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD Jul 23 22:34:06 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:07 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:07 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD Jul 23 22:34:07 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:07 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:34:07 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] f7522e81-520c-48da-a475-f854ea41cc47 was raw, converting to raw {{(pid=88308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 22:34:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:07 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 Jul 23 22:34:07 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:07 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167" returned: 0 in 0.321s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:07 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f7522e81-520c-48da-a475-f854ea41cc47_mrxuyrondevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:34:07 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 22:34:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:07 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 1G Jul 23 22:34:07 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:08 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 1G" returned: 0 in 0.308s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:08 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccabed1-6e49-4d5c-93e1-645e5e633adb]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:08 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 Jul 23 22:34:08 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:08 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167" returned: 0 in 0.386s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:08 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 Jul 23 22:34:08 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:08 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167" returned: 1 in 0.367s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:34:08 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Downloaded image f7522e81-520c-48da-a475-f854ea41cc47 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7522e81-520c-48da-a475-f854ea41cc47', 'metadata': {}}])) to volume d4d6d8f1-812c-492f-91bb-957a456b2167 successfully. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 22:34:08 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Temporary image f7522e81-520c-48da-a475-f854ea41cc47 for user 1f464133135b4fdbb4def7bb54542a8f is deleted. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 22:34:08 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Marking volume d4d6d8f1-812c-492f-91bb-957a456b2167 as bootable. {{(pid=88308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 22:34:09 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Copying metadata from image f7522e81-520c-48da-a475-f854ea41cc47 to d4d6d8f1-812c-492f-91bb-957a456b2167. {{(pid=88308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 22:34:09 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Creating volume glance metadata for volume d4d6d8f1-812c-492f-91bb-957a456b2167 backed by image f7522e81-520c-48da-a475-f854ea41cc47 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f7522e81-520c-48da-a475-f854ea41cc47', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '949edbd5de8c3dd1869f8a124480f565', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 22:34:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7115c4-363d-4e4d-8cb6-7a641500f526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4d6d8f1-812c-492f-91bb-957a456b2167', 'volume_size': 1, 'image_id': 'f7522e81-520c-48da-a475-f854ea41cc47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7522e81-520c-48da-a475-f854ea41cc47', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '949edbd5de8c3dd1869f8a124480f565', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a5cfbac39fd4acbb8b67dc8d256da01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '92205f3533014cbce2f6060d443299e4c216f975203d30da8578b1a2fab5bf36a4f6454242998c5d2fb712d9a936d7dd493cc80923fe8eda978f65a51b41c707', 'id': 'f7522e81-520c-48da-a475-f854ea41cc47', 'created_at': datetime.datetime(2026, 7, 23, 20, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 34, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7522e81-520c-48da-a475-f854ea41cc47/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d179daa9-5406-46b1-a93c-ad26e3358225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:09 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Volume volume-d4d6d8f1-812c-492f-91bb-957a456b2167 (d4d6d8f1-812c-492f-91bb-957a456b2167): created successfully Jul 23 22:34:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d179daa9-5406-46b1-a93c-ad26e3358225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Flow 'volume_create_manager' (f0dfbca9-9723-4917-8ae2-27fb09706769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:09 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-3a10cdf5-482c-4ed0-8c0f-cec3fc03be3d tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Created volume successfully. Jul 23 22:34:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Acquiring lock "cinder-d4d6d8f1-812c-492f-91bb-957a456b2167-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Lock "cinder-d4d6d8f1-812c-492f-91bb-957a456b2167-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Acquiring lock "cinder-quobyte-d4d6d8f1-812c-492f-91bb-957a456b2167" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Lock "cinder-quobyte-d4d6d8f1-812c-492f-91bb-957a456b2167" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:09 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5776c69b-b5f9-486f-b6bc-ec0cb810aef4]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:09 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 Jul 23 22:34:09 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:09 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167" returned: 0 in 0.353s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:10 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 Jul 23 22:34:10 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:10 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167" returned: 1 in 0.389s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:34:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:10 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167 Jul 23 22:34:10 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:10 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d4d6d8f1-812c-492f-91bb-957a456b2167" returned: 0 in 0.272s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Lock "cinder-quobyte-d4d6d8f1-812c-492f-91bb-957a456b2167" released by "delete_volume" :: held 1.084s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:10 devstack cinder-volume[88308]: WARNING cinder.quota [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:34:10 devstack cinder-volume[88308]: WARNING cinder.quota [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 23 22:34:10 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Created reservations ['1c37b649-5105-4aef-9389-c2c848873f6d', '03af4e86-b6fd-4fdc-bebe-801f392f5794', 'd2cfb49e-941e-41bf-9d1f-c4f9fc2fb6cd', '53056976-ab5b-41cc-8345-130c35fd598c'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:34:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:10 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:34:10 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:11 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.253s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:11 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:34:11 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Deleted volume successfully. Jul 23 22:34:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c1a76dbe-8f92-4627-8447-99a6d71023c7 tempest-VolumeAndVolumeTypeFromImageTest-774170996 None] Lock "cinder-d4d6d8f1-812c-492f-91bb-957a456b2167-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-8cfa4609-b6b3-4e7e-9b39-5a1a9019203f req-6aa76c15-4c98-4a3d-84cf-743568570de6 tempest-TestStampPattern-1900735528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-8cfa4609-b6b3-4e7e-9b39-5a1a9019203f req-6aa76c15-4c98-4a3d-84cf-743568570de6 tempest-TestStampPattern-1900735528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:16 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b993a1c-9d70-47ae-a8f5-aec927ca5617]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-8cfa4609-b6b3-4e7e-9b39-5a1a9019203f req-6aa76c15-4c98-4a3d-84cf-743568570de6 tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:16 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38 Jul 23 22:34:16 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:16 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-8cfa4609-b6b3-4e7e-9b39-5a1a9019203f req-6aa76c15-4c98-4a3d-84cf-743568570de6 tempest-TestStampPattern-1900735528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38" returned: 0 in 0.463s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-8cfa4609-b6b3-4e7e-9b39-5a1a9019203f req-6aa76c15-4c98-4a3d-84cf-743568570de6 tempest-TestStampPattern-1900735528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.493s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-8cfa4609-b6b3-4e7e-9b39-5a1a9019203f req-6aa76c15-4c98-4a3d-84cf-743568570de6 tempest-TestStampPattern-1900735528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7c75c94-efb0-4967-bb55-3bc79f60ff28', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:34:16 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-8cfa4609-b6b3-4e7e-9b39-5a1a9019203f req-6aa76c15-4c98-4a3d-84cf-743568570de6 tempest-TestStampPattern-1900735528 None] attachment_update completed successfully. Jul 23 22:34:18 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:34:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Flow 'volume_create_manager' (64e803c0-4399-4822-aa49-add543d9b2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40eacd1d-a8fb-40c3-9ec1-b25ff0a4a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40eacd1d-a8fb-40c3-9ec1-b25ff0a4a10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-361834293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca54d713-11a8-44d4-a1a5-dc37d55b3910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9258229b0e4a48cabb9662afd0daa4c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:19Z,use_quota=True,user_id='0a7b08435ab44b09b2c5f3fdc9296cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ded0829-9c74-40f7-9620-ecf9e99fe6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ded0829-9c74-40f7-9620-ecf9e99fe6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f3bdbe-b0b6-44b1-9557-c85c68d0cb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f3bdbe-b0b6-44b1-9557-c85c68d0cb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca54d713-11a8-44d4-a1a5-dc37d55b3910', 'volume_name': 'volume-ca54d713-11a8-44d4-a1a5-dc37d55b3910', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66eca03-e634-4820-8861-1f4edeb7038c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66eca03-e634-4820-8861-1f4edeb7038c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2636ea5-37a7-4a51-8ac4-5a6bcbf184cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:19 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Volume ca54d713-11a8-44d4-a1a5-dc37d55b3910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca54d713-11a8-44d4-a1a5-dc37d55b3910', 'volume_size': 1} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-361834293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca54d713-11a8-44d4-a1a5-dc37d55b3910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9258229b0e4a48cabb9662afd0daa4c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:19Z,use_quota=True,user_id='0a7b08435ab44b09b2c5f3fdc9296cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Creating volume ca54d713-11a8-44d4-a1a5-dc37d55b3910 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:34:19 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ca54d713-11a8-44d4-a1a5-dc37d55b3910 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:19 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ca54d713-11a8-44d4-a1a5-dc37d55b3910 1073741824 Jul 23 22:34:19 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Flow 'volume_create_manager' (ae0fe99d-f5e9-4e8b-83eb-a9928ec34e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5d86d8-ddb3-4aa9-8b6f-5e8455fb03ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5d86d8-ddb3-4aa9-8b6f-5e8455fb03ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1830460626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f833947d-02ea-41f6-9d69-7a17b46e25f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9258229b0e4a48cabb9662afd0daa4c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:19Z,use_quota=True,user_id='0a7b08435ab44b09b2c5f3fdc9296cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0c5c0b-af48-434e-9cd7-d5d000448dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0c5c0b-af48-434e-9cd7-d5d000448dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c883d58f-7e7f-4fc4-9ce4-b708aac8d5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c883d58f-7e7f-4fc4-9ce4-b708aac8d5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f833947d-02ea-41f6-9d69-7a17b46e25f8', 'volume_name': 'volume-f833947d-02ea-41f6-9d69-7a17b46e25f8', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c920d0c-44f5-4e9e-924d-8108872f1c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c920d0c-44f5-4e9e-924d-8108872f1c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93870fd-6e8b-4b5c-9d88-a7a88612d448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:19 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Volume f833947d-02ea-41f6-9d69-7a17b46e25f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f833947d-02ea-41f6-9d69-7a17b46e25f8', 'volume_size': 1} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:19 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ca54d713-11a8-44d4-a1a5-dc37d55b3910 1073741824" returned: 0 in 0.790s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Flow 'volume_create_manager' (00167384-c2d8-4dc7-bec1-063ad58e6346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841d223a-1539-4776-a6f1-f36b0959fd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ca54d713-11a8-44d4-a1a5-dc37d55b3910 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841d223a-1539-4776-a6f1-f36b0959fd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-776984568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bdad0dd-3f8c-43e9-9fd2-f205f58cb958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9258229b0e4a48cabb9662afd0daa4c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:20Z,use_quota=True,user_id='0a7b08435ab44b09b2c5f3fdc9296cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb30f2b-a92d-4936-a45a-e12ce2123db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:19 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ca54d713-11a8-44d4-a1a5-dc37d55b3910 Jul 23 22:34:19 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb30f2b-a92d-4936-a45a-e12ce2123db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a923ba-1c0e-4694-ab19-b0001747eb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a923ba-1c0e-4694-ab19-b0001747eb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bdad0dd-3f8c-43e9-9fd2-f205f58cb958', 'volume_name': 'volume-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde53b18-b3a2-4839-afe9-3316cb1c604b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde53b18-b3a2-4839-afe9-3316cb1c604b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3202861e-5ff4-4821-a962-f30e5026ec88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:20 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Volume 3bdad0dd-3f8c-43e9-9fd2-f205f58cb958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958', 'volume_size': 1} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:20 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-b56fd279-dc87-45ec-a579-72780f9c60bb req-4cf3dcf5-58d5-4e3a-895d-544a85c526ce tempest-TestStampPattern-1900735528 None] Terminate volume connection completed successfully. Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-b56fd279-dc87-45ec-a579-72780f9c60bb req-4cf3dcf5-58d5-4e3a-895d-544a85c526ce tempest-TestStampPattern-1900735528 None] Deleting attachment e7c75c94-efb0-4967-bb55-3bc79f60ff28. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Flow 'volume_create_manager' (55780cf7-8054-4fae-bbfc-58cfa4bfe117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9469ec-4fc8-46a2-8a0a-970874f89d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9469ec-4fc8-46a2-8a0a-970874f89d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1615968391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddba7b51-a8af-407a-8748-3b6e6f6c04d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9258229b0e4a48cabb9662afd0daa4c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:20Z,use_quota=True,user_id='0a7b08435ab44b09b2c5f3fdc9296cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac870329-d693-40f7-ba79-5d0fe536ee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac870329-d693-40f7-ba79-5d0fe536ee5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ad4e8e-e2b0-4e76-8370-a16011fd2aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ad4e8e-e2b0-4e76-8370-a16011fd2aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddba7b51-a8af-407a-8748-3b6e6f6c04d4', 'volume_name': 'volume-ddba7b51-a8af-407a-8748-3b6e6f6c04d4', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ab18f7-46b4-4c2b-a56a-dda482a73b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ab18f7-46b4-4c2b-a56a-dda482a73b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e18c55-a226-4de1-9b75-dbc973d4b17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:20 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Volume ddba7b51-a8af-407a-8748-3b6e6f6c04d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddba7b51-a8af-407a-8748-3b6e6f6c04d4', 'volume_size': 1} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:20 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ca54d713-11a8-44d4-a1a5-dc37d55b3910" returned: 0 in 0.521s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.831s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1830460626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f833947d-02ea-41f6-9d69-7a17b46e25f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9258229b0e4a48cabb9662afd0daa4c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:19Z,use_quota=True,user_id='0a7b08435ab44b09b2c5f3fdc9296cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Creating volume f833947d-02ea-41f6-9d69-7a17b46e25f8 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:34:20 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f833947d-02ea-41f6-9d69-7a17b46e25f8 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2636ea5-37a7-4a51-8ac4-5a6bcbf184cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca54d713-11a8-44d4-a1a5-dc37d55b3910', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337feba1-0447-4de0-8361-1b63ad6df550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:20 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f833947d-02ea-41f6-9d69-7a17b46e25f8 1073741824 Jul 23 22:34:20 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:20 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Volume volume-ca54d713-11a8-44d4-a1a5-dc37d55b3910 (ca54d713-11a8-44d4-a1a5-dc37d55b3910): created successfully Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337feba1-0447-4de0-8361-1b63ad6df550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Flow 'volume_create_manager' (64e803c0-4399-4822-aa49-add543d9b2d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:20 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6db0bcf4-cbcd-4765-94a4-9836484ec95b tempest-CreateVolumesFromImageTest-1998762647 None] Created volume successfully. Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Flow 'volume_create_manager' (4e56d29a-4e33-49c2-b049-94f40aed44fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc100f61-24f3-4d9a-9a5e-0cc81b7e2eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc100f61-24f3-4d9a-9a5e-0cc81b7e2eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-790700531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bba63f-5b5a-4c87-adef-0a0dd5ceea57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9258229b0e4a48cabb9662afd0daa4c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:21Z,use_quota=True,user_id='0a7b08435ab44b09b2c5f3fdc9296cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41556992-c4b2-494d-8262-a79312cd2ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41556992-c4b2-494d-8262-a79312cd2ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409a6ea8-4fd2-443f-be1e-2855d618bb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409a6ea8-4fd2-443f-be1e-2855d618bb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60bba63f-5b5a-4c87-adef-0a0dd5ceea57', 'volume_name': 'volume-60bba63f-5b5a-4c87-adef-0a0dd5ceea57', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9aa6187-b4e6-4e60-b279-64140bbd3c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9aa6187-b4e6-4e60-b279-64140bbd3c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:21 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ac5ad4-fb58-4747-99e0-a324b2965a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:21 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Volume 60bba63f-5b5a-4c87-adef-0a0dd5ceea57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60bba63f-5b5a-4c87-adef-0a0dd5ceea57', 'volume_size': 1} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f833947d-02ea-41f6-9d69-7a17b46e25f8 1073741824" returned: 0 in 0.685s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f833947d-02ea-41f6-9d69-7a17b46e25f8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:21 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f833947d-02ea-41f6-9d69-7a17b46e25f8 Jul 23 22:34:21 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:21 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f833947d-02ea-41f6-9d69-7a17b46e25f8" returned: 0 in 0.357s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.550s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-776984568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bdad0dd-3f8c-43e9-9fd2-f205f58cb958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9258229b0e4a48cabb9662afd0daa4c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:20Z,use_quota=True,user_id='0a7b08435ab44b09b2c5f3fdc9296cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Creating volume 3bdad0dd-3f8c-43e9-9fd2-f205f58cb958 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:34:21 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93870fd-6e8b-4b5c-9d88-a7a88612d448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f833947d-02ea-41f6-9d69-7a17b46e25f8', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44666b0-d7ca-435b-822e-79816d1d53ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:21 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958 1073741824 Jul 23 22:34:21 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:21 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Volume volume-f833947d-02ea-41f6-9d69-7a17b46e25f8 (f833947d-02ea-41f6-9d69-7a17b46e25f8): created successfully Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44666b0-d7ca-435b-822e-79816d1d53ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:21 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Flow 'volume_create_manager' (ae0fe99d-f5e9-4e8b-83eb-a9928ec34e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:21 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f60c42e6-2407-476c-9f9c-b31b78d89e84 tempest-CreateVolumesFromImageTest-1998762647 None] Created volume successfully. Jul 23 22:34:22 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958 1073741824" returned: 0 in 0.841s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:22 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958 Jul 23 22:34:22 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:22 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958" returned: 0 in 0.489s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:34:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.550s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1615968391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddba7b51-a8af-407a-8748-3b6e6f6c04d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9258229b0e4a48cabb9662afd0daa4c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:20Z,use_quota=True,user_id='0a7b08435ab44b09b2c5f3fdc9296cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:34:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Creating volume ddba7b51-a8af-407a-8748-3b6e6f6c04d4 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:34:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:34:22 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:34:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ddba7b51-a8af-407a-8748-3b6e6f6c04d4 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3202861e-5ff4-4821-a962-f30e5026ec88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be7ffc9-4886-4560-a115-a5575aa480cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:23 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Volume volume-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958 (3bdad0dd-3f8c-43e9-9fd2-f205f58cb958): created successfully Jul 23 22:34:23 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ddba7b51-a8af-407a-8748-3b6e6f6c04d4 1073741824 Jul 23 22:34:23 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be7ffc9-4886-4560-a115-a5575aa480cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Flow 'volume_create_manager' (00167384-c2d8-4dc7-bec1-063ad58e6346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:23 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-43aae09a-ba4d-4a30-9b03-035e4b1d6c81 tempest-CreateVolumesFromImageTest-1998762647 None] Created volume successfully. Jul 23 22:34:23 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ddba7b51-a8af-407a-8748-3b6e6f6c04d4 1073741824" returned: 0 in 0.888s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ddba7b51-a8af-407a-8748-3b6e6f6c04d4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:23 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ddba7b51-a8af-407a-8748-3b6e6f6c04d4 Jul 23 22:34:23 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:24 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ddba7b51-a8af-407a-8748-3b6e6f6c04d4" returned: 0 in 0.498s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.304s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-790700531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bba63f-5b5a-4c87-adef-0a0dd5ceea57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9258229b0e4a48cabb9662afd0daa4c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:21Z,use_quota=True,user_id='0a7b08435ab44b09b2c5f3fdc9296cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Creating volume 60bba63f-5b5a-4c87-adef-0a0dd5ceea57 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:34:24 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-60bba63f-5b5a-4c87-adef-0a0dd5ceea57 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e18c55-a226-4de1-9b75-dbc973d4b17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddba7b51-a8af-407a-8748-3b6e6f6c04d4', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a13a4a-d3db-4957-9dea-3f09987bb374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:24 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-60bba63f-5b5a-4c87-adef-0a0dd5ceea57 1073741824 Jul 23 22:34:24 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:24 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Volume volume-ddba7b51-a8af-407a-8748-3b6e6f6c04d4 (ddba7b51-a8af-407a-8748-3b6e6f6c04d4): created successfully Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a13a4a-d3db-4957-9dea-3f09987bb374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Flow 'volume_create_manager' (55780cf7-8054-4fae-bbfc-58cfa4bfe117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:24 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-db3b0e82-2a6e-4bd9-bc31-83d6e01e1f54 tempest-CreateVolumesFromImageTest-1998762647 None] Created volume successfully. Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Acquiring lock "cinder-dc0992e5-3035-4e93-b8ea-f795ecc4ab38-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Lock "cinder-dc0992e5-3035-4e93-b8ea-f795ecc4ab38-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Acquiring lock "cinder-quobyte-dc0992e5-3035-4e93-b8ea-f795ecc4ab38" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-60bba63f-5b5a-4c87-adef-0a0dd5ceea57 1073741824" returned: 0 in 0.643s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:25 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Lock "cinder-quobyte-dc0992e5-3035-4e93-b8ea-f795ecc4ab38" acquired by "delete_volume" :: waited 0.026s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3fc2f0-4cc6-423c-823e-102c585229e4]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-60bba63f-5b5a-4c87-adef-0a0dd5ceea57 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:25 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-60bba63f-5b5a-4c87-adef-0a0dd5ceea57 Jul 23 22:34:25 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:25 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38 Jul 23 22:34:25 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:25 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-60bba63f-5b5a-4c87-adef-0a0dd5ceea57" returned: 0 in 0.297s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ac5ad4-fb58-4747-99e0-a324b2965a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60bba63f-5b5a-4c87-adef-0a0dd5ceea57', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0f4d96-0a25-473e-a963-6f1a3c2147ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:25 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Volume volume-60bba63f-5b5a-4c87-adef-0a0dd5ceea57 (60bba63f-5b5a-4c87-adef-0a0dd5ceea57): created successfully Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0f4d96-0a25-473e-a963-6f1a3c2147ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Flow 'volume_create_manager' (4e56d29a-4e33-49c2-b049-94f40aed44fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:25 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-649b9be8-dea0-4140-a3c8-8f293078e4c7 tempest-CreateVolumesFromImageTest-1998762647 None] Created volume successfully. Jul 23 22:34:25 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38" returned: 0 in 0.443s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:25 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38 Jul 23 22:34:25 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "cinder-60bba63f-5b5a-4c87-adef-0a0dd5ceea57-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-60bba63f-5b5a-4c87-adef-0a0dd5ceea57-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "cinder-quobyte-60bba63f-5b5a-4c87-adef-0a0dd5ceea57" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-quobyte-60bba63f-5b5a-4c87-adef-0a0dd5ceea57" acquired by "delete_volume" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[759d5b9c-dc28-4a2c-9bfc-49f318850102]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-60bba63f-5b5a-4c87-adef-0a0dd5ceea57 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:26 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dc0992e5-3035-4e93-b8ea-f795ecc4ab38" returned: 0 in 0.394s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Lock "cinder-quobyte-dc0992e5-3035-4e93-b8ea-f795ecc4ab38" released by "delete_volume" :: held 0.899s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Created reservations ['5cb58db6-c659-4a4c-b362-51316818a8b4', '8cc215a1-b5ec-4c84-9e74-efe18da1e757', 'f13b9020-1495-4084-971c-0bc76f11db3e', '304da684-af9d-4eff-bd6d-6371af0a2ef5'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:26 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-60bba63f-5b5a-4c87-adef-0a0dd5ceea57 Jul 23 22:34:26 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:26 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:34:26 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:26 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:34:26 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:26 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.454s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 29 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:34:26 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-60bba63f-5b5a-4c87-adef-0a0dd5ceea57" returned: 0 in 0.678s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-60bba63f-5b5a-4c87-adef-0a0dd5ceea57 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:26 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-60bba63f-5b5a-4c87-adef-0a0dd5ceea57 Jul 23 22:34:26 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:26 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.655s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:34:26 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Deleted volume successfully. Jul 23 22:34:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-eb58d647-902c-4697-9afd-09dccac2f3ca tempest-TestStampPattern-1900735528 None] Lock "cinder-dc0992e5-3035-4e93-b8ea-f795ecc4ab38-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Acquiring lock "cinder-d3a3f3be-3229-46cc-936f-c6acf3edc63a-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Lock "cinder-d3a3f3be-3229-46cc-936f-c6acf3edc63a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Acquiring lock "cinder-quobyte-32578acb-7e1a-439c-aff1-8195b83306d1" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Lock "cinder-quobyte-32578acb-7e1a-439c-aff1-8195b83306d1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Acquiring lock "cinder-quobyte-d3a3f3be-3229-46cc-936f-c6acf3edc63a" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Lock "cinder-quobyte-d3a3f3be-3229-46cc-936f-c6acf3edc63a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Deleting offline snapshot d3a3f3be-3229-46cc-936f-c6acf3edc63a of volume 32578acb-7e1a-439c-aff1-8195b83306d1 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] snapshot_file for this snap is: volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f911154-60c9-42ee-841b-966f1dfdcff7]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:27 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-60bba63f-5b5a-4c87-adef-0a0dd5ceea57" returned: 0 in 0.614s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-quobyte-60bba63f-5b5a-4c87-adef-0a0dd5ceea57" released by "delete_volume" :: held 1.360s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:27 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a Jul 23 22:34:27 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Created reservations ['f232d6a0-5064-4c30-a7a7-b5f9dd3716b8', '5adad6a2-0bf3-4fed-bcf5-6c94f5d480c8', '8d688b01-ffe5-41a4-ad0f-ec9fb364c1bc', 'dabc1b24-18c8-42f0-b3ce-a83a4bb2cf9e'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:27 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:34:27 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:27 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a" returned: 0 in 0.711s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32578acb-7e1a-439c-aff1-8195b83306d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95bbddd-6fd8-4d07-96c9-23886f671629]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:27 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.350s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:27 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:34:27 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Deleted volume successfully. Jul 23 22:34:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-68437d31-79d2-4332-81f9-07e5fe4ab080 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-60bba63f-5b5a-4c87-adef-0a0dd5ceea57-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:28 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 Jul 23 22:34:28 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "cinder-ddba7b51-a8af-407a-8748-3b6e6f6c04d4-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-ddba7b51-a8af-407a-8748-3b6e6f6c04d4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "cinder-quobyte-ddba7b51-a8af-407a-8748-3b6e6f6c04d4" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-quobyte-ddba7b51-a8af-407a-8748-3b6e6f6c04d4" acquired by "delete_volume" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:28 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a898b8e-1bec-485b-b2ee-d9c93d87a5b0]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ddba7b51-a8af-407a-8748-3b6e6f6c04d4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:28 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1" returned: 0 in 0.533s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:28 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ddba7b51-a8af-407a-8748-3b6e6f6c04d4 Jul 23 22:34:28 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:28 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a Jul 23 22:34:28 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:28 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ddba7b51-a8af-407a-8748-3b6e6f6c04d4" returned: 0 in 0.445s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ddba7b51-a8af-407a-8748-3b6e6f6c04d4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:28 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ddba7b51-a8af-407a-8748-3b6e6f6c04d4 Jul 23 22:34:28 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:28 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a" returned: 0 in 0.389s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:28 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a Jul 23 22:34:28 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:29 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ddba7b51-a8af-407a-8748-3b6e6f6c04d4" returned: 0 in 0.269s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-quobyte-ddba7b51-a8af-407a-8748-3b6e6f6c04d4" released by "delete_volume" :: held 0.778s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:29 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1.d3a3f3be-3229-46cc-936f-c6acf3edc63a" returned: 0 in 0.270s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Created reservations ['0e626314-d798-4806-a50f-f6b000790a9b', '3ee11439-53d3-4431-b9a4-9bdf23af83bf', '55593f7a-618a-4b80-9002-3f16f682a7d4', '6dbe2888-8d83-407e-a87f-9f88f0af2e39'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Lock "cinder-quobyte-d3a3f3be-3229-46cc-936f-c6acf3edc63a" released by "_delete_snapshot" :: held 2.065s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Lock "cinder-quobyte-32578acb-7e1a-439c-aff1-8195b83306d1" released by "delete_snapshot" :: held 2.107s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:29 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:34:29 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Created reservations ['1f9f2639-815e-4715-a5a4-53d5987264e8', 'b2986ac4-aa47-4c5d-9c42-b636c9816f31', '9b621ebf-4cd9-4fe2-83fc-ff461bbdcde7', '72cc325b-ca26-46c7-bf18-b93d4010f887'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "cinder-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "cinder-quobyte-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:29 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Delete snapshot completed successfully. Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4248e16c-61b1-4949-a345-cdad7943a5a0 tempest-TestStampPattern-1900735528 None] Lock "cinder-d3a3f3be-3229-46cc-936f-c6acf3edc63a-delete_snapshot" released by "delete_snapshot" :: held 2.522s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-quobyte-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958" acquired by "delete_volume" :: waited 0.046s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cd7a14-f3db-4ee9-8230-d6f791ea9cbb]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:29 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.431s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:34:29 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Deleted volume successfully. Jul 23 22:34:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b03bb751-1208-4590-ac57-17ea430ecbab tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-ddba7b51-a8af-407a-8748-3b6e6f6c04d4-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:29 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958 Jul 23 22:34:29 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:30 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958" returned: 0 in 0.420s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:30 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958 Jul 23 22:34:30 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:30 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958" returned: 0 in 0.371s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-quobyte-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958" released by "delete_volume" :: held 0.869s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:30 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Created reservations ['69f9bdbf-1e83-444d-9a50-16bf22d1e7d1', '70f26382-06a6-4349-87ec-f30019a92103', '8a881d06-81a5-4247-a164-dd413fc2cbd0', 'a704500d-32d2-43c7-a9ff-272c8b1bbdf6'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:34:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:30 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:34:30 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "cinder-f833947d-02ea-41f6-9d69-7a17b46e25f8-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-f833947d-02ea-41f6-9d69-7a17b46e25f8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "cinder-quobyte-f833947d-02ea-41f6-9d69-7a17b46e25f8" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-quobyte-f833947d-02ea-41f6-9d69-7a17b46e25f8" acquired by "delete_volume" :: waited 0.034s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94902b1-a4e6-4510-9485-5e4d51f296d8]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f833947d-02ea-41f6-9d69-7a17b46e25f8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:31 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.475s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:34:31 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Deleted volume successfully. Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-607afcb5-d164-4c04-bf25-959b66c5cf32 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-3bdad0dd-3f8c-43e9-9fd2-f205f58cb958-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:31 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f833947d-02ea-41f6-9d69-7a17b46e25f8 Jul 23 22:34:31 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:31 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f833947d-02ea-41f6-9d69-7a17b46e25f8" returned: 0 in 0.661s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f833947d-02ea-41f6-9d69-7a17b46e25f8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:31 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f833947d-02ea-41f6-9d69-7a17b46e25f8 Jul 23 22:34:31 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Flow 'volume_create_manager' (87c36ce6-d2aa-4634-ba22-aec60e8b2089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e44ed6-f3b7-48b1-a215-c698ae4ff286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e44ed6-f3b7-48b1-a215-c698ae4ff286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-997289371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6116c29c-bd69-446d-b580-a29531fb94e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d616b9878d42a9a7ff19fdd5eda4ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:32Z,use_quota=True,user_id='ef15cb3ed61943d195d23a1b29c008fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2458afc-96a6-4b6f-9d4e-7bde4561d749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2458afc-96a6-4b6f-9d4e-7bde4561d749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14eb907d-ff9f-43fa-8622-6736fa7199fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14eb907d-ff9f-43fa-8622-6736fa7199fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6116c29c-bd69-446d-b580-a29531fb94e0', 'volume_name': 'volume-6116c29c-bd69-446d-b580-a29531fb94e0', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99876ded-8938-43e3-8f2e-823d4d18cddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99876ded-8938-43e3-8f2e-823d4d18cddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5cd592-d62f-4457-b75b-c252ea98a612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:31 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Volume 6116c29c-bd69-446d-b580-a29531fb94e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6116c29c-bd69-446d-b580-a29531fb94e0', 'volume_size': 1} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-997289371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6116c29c-bd69-446d-b580-a29531fb94e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d616b9878d42a9a7ff19fdd5eda4ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:32Z,use_quota=True,user_id='ef15cb3ed61943d195d23a1b29c008fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Creating volume 6116c29c-bd69-446d-b580-a29531fb94e0 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:34:31 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:34:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6116c29c-bd69-446d-b580-a29531fb94e0 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:32 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6116c29c-bd69-446d-b580-a29531fb94e0 1073741824 Jul 23 22:34:32 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:32 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-f833947d-02ea-41f6-9d69-7a17b46e25f8" returned: 0 in 0.496s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:32 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-quobyte-f833947d-02ea-41f6-9d69-7a17b46e25f8" released by "delete_volume" :: held 1.232s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:32 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Created reservations ['3f036cb6-4f0b-4d1c-96e7-71bb5faa5e83', 'b64176d5-0bc0-44bf-b45c-0e761dcdb9c6', '30f7720a-fc02-4e76-92fa-7ef1c5d0ff11', 'caa0231f-a188-4848-b1b1-5003338946ad'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:34:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:32 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:34:32 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:32 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6116c29c-bd69-446d-b580-a29531fb94e0 1073741824" returned: 0 in 0.828s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6116c29c-bd69-446d-b580-a29531fb94e0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:32 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6116c29c-bd69-446d-b580-a29531fb94e0 Jul 23 22:34:32 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:32 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.554s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:32 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:34:32 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Deleted volume successfully. Jul 23 22:34:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b7c4f70d-58cd-41d1-a94d-a8ecf5382910 tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-f833947d-02ea-41f6-9d69-7a17b46e25f8-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "cinder-ca54d713-11a8-44d4-a1a5-dc37d55b3910-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:33 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6116c29c-bd69-446d-b580-a29531fb94e0" returned: 0 in 0.449s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:34:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-ca54d713-11a8-44d4-a1a5-dc37d55b3910-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5cd592-d62f-4457-b75b-c252ea98a612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6116c29c-bd69-446d-b580-a29531fb94e0', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d767b1-76e8-4335-8e29-b221e2f7856e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:33 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Volume volume-6116c29c-bd69-446d-b580-a29531fb94e0 (6116c29c-bd69-446d-b580-a29531fb94e0): created successfully Jul 23 22:34:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d767b1-76e8-4335-8e29-b221e2f7856e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Flow 'volume_create_manager' (87c36ce6-d2aa-4634-ba22-aec60e8b2089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "cinder-quobyte-ca54d713-11a8-44d4-a1a5-dc37d55b3910" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:33 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-7a6e5893-dd32-48d4-9c88-9cfa0cec442e tempest-TestMinimumBasicScenario-1818597862 None] Created volume successfully. Jul 23 22:34:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-quobyte-ca54d713-11a8-44d4-a1a5-dc37d55b3910" acquired by "delete_volume" :: waited 0.030s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:33 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d2956a-1c64-48fa-ba47-38a681db2dda]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ca54d713-11a8-44d4-a1a5-dc37d55b3910 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:33 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ca54d713-11a8-44d4-a1a5-dc37d55b3910 Jul 23 22:34:33 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:34 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ca54d713-11a8-44d4-a1a5-dc37d55b3910" returned: 0 in 0.565s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ca54d713-11a8-44d4-a1a5-dc37d55b3910 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:34 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ca54d713-11a8-44d4-a1a5-dc37d55b3910 Jul 23 22:34:34 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:34 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ca54d713-11a8-44d4-a1a5-dc37d55b3910" returned: 0 in 0.428s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:34 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-quobyte-ca54d713-11a8-44d4-a1a5-dc37d55b3910" released by "delete_volume" :: held 1.053s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:34 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Created reservations ['ce762409-62da-4aa6-a955-52d0e9d7211b', 'fd9278bc-602b-45ac-89ad-3c6ea0b5473f', '824c0c63-fe63-4992-8ba9-ac5f7d4f49b7', 'a4a68b49-79cf-40a2-8798-e289444ad199'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:34:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:34 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:34:34 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:35 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.303s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:34:35 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Deleted volume successfully. Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-109c1d5b-401a-45fd-ab95-4d90d41ffb8e tempest-CreateVolumesFromImageTest-1998762647 None] Lock "cinder-ca54d713-11a8-44d4-a1a5-dc37d55b3910-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Acquiring lock "cinder-32578acb-7e1a-439c-aff1-8195b83306d1-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Lock "cinder-32578acb-7e1a-439c-aff1-8195b83306d1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Acquiring lock "cinder-quobyte-32578acb-7e1a-439c-aff1-8195b83306d1" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Lock "cinder-quobyte-32578acb-7e1a-439c-aff1-8195b83306d1" acquired by "delete_volume" :: waited 0.033s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-dde306fb-4010-4a6f-a7bd-9930299117f1 req-12be17b4-1fb5-4502-9e91-6acecc4605c5 tempest-TestMinimumBasicScenario-1818597862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-dde306fb-4010-4a6f-a7bd-9930299117f1 req-12be17b4-1fb5-4502-9e91-6acecc4605c5 tempest-TestMinimumBasicScenario-1818597862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[507f7a7b-73b4-4bf8-a09f-075ff91e9c44]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a8847f-74f3-4fc3-8d0c-3891e1337f42]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-dde306fb-4010-4a6f-a7bd-9930299117f1 req-12be17b4-1fb5-4502-9e91-6acecc4605c5 tempest-TestMinimumBasicScenario-1818597862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6116c29c-bd69-446d-b580-a29531fb94e0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:35 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 Jul 23 22:34:35 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:35 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6116c29c-bd69-446d-b580-a29531fb94e0 Jul 23 22:34:35 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:35 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-dde306fb-4010-4a6f-a7bd-9930299117f1 req-12be17b4-1fb5-4502-9e91-6acecc4605c5 tempest-TestMinimumBasicScenario-1818597862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6116c29c-bd69-446d-b580-a29531fb94e0" returned: 0 in 0.399s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:35 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-dde306fb-4010-4a6f-a7bd-9930299117f1 req-12be17b4-1fb5-4502-9e91-6acecc4605c5 tempest-TestMinimumBasicScenario-1818597862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.428s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1" returned: 0 in 0.434s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:35 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1 Jul 23 22:34:35 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-dde306fb-4010-4a6f-a7bd-9930299117f1 req-12be17b4-1fb5-4502-9e91-6acecc4605c5 tempest-TestMinimumBasicScenario-1818597862 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-6116c29c-bd69-446d-b580-a29531fb94e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd3cb0f5-5eb1-47d2-bbbd-bb8ed3a0bfe1', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:34:35 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-dde306fb-4010-4a6f-a7bd-9930299117f1 req-12be17b4-1fb5-4502-9e91-6acecc4605c5 tempest-TestMinimumBasicScenario-1818597862 None] attachment_update completed successfully. Jul 23 22:34:36 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-32578acb-7e1a-439c-aff1-8195b83306d1" returned: 0 in 0.367s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Lock "cinder-quobyte-32578acb-7e1a-439c-aff1-8195b83306d1" released by "delete_volume" :: held 0.878s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:36 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Created reservations ['a6cb4d10-91ad-44da-94e0-b2044d1fa82e', '27208e4a-3716-41a4-b39d-e60234fef502', 'e750c8b2-9303-4e7d-8d7f-be3c0b286c88', '51be13aa-c916-4dde-82eb-9dc3a2873e49'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:34:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:36 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:34:36 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:36 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.366s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:36 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:34:36 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Deleted volume successfully. Jul 23 22:34:36 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1e8f2d00-c36b-44bb-9f2a-909d45f7baba tempest-TestStampPattern-1900735528 None] Lock "cinder-32578acb-7e1a-439c-aff1-8195b83306d1-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Flow 'volume_create_manager' (12a182c4-b913-4f79-8b29-e215bceffee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8285c6c7-6b25-471b-9f19-146dafa7b478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8285c6c7-6b25-471b-9f19-146dafa7b478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1230469312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea454c75-887d-420b-8892-76cd6656dd36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307932ad9b804a0ba496ac43ad3cc565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:40Z,use_quota=True,user_id='767b6ba61d8e4502bff348a23126260a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec27c444-48ce-4b8f-8a87-de17aba65310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec27c444-48ce-4b8f-8a87-de17aba65310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ff9848-757b-44f2-929f-7d807162dc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ff9848-757b-44f2-929f-7d807162dc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea454c75-887d-420b-8892-76cd6656dd36', 'volume_name': 'volume-ea454c75-887d-420b-8892-76cd6656dd36', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2432e8-1093-4d34-84ae-1c1b8461bab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2432e8-1093-4d34-84ae-1c1b8461bab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb46681-c4e9-4c04-a87b-62f464e34522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:39 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume ea454c75-887d-420b-8892-76cd6656dd36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea454c75-887d-420b-8892-76cd6656dd36', 'volume_size': 1} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1230469312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea454c75-887d-420b-8892-76cd6656dd36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307932ad9b804a0ba496ac43ad3cc565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:40Z,use_quota=True,user_id='767b6ba61d8e4502bff348a23126260a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Creating volume ea454c75-887d-420b-8892-76cd6656dd36 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:34:39 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:34:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ea454c75-887d-420b-8892-76cd6656dd36 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:39 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ea454c75-887d-420b-8892-76cd6656dd36 1073741824 Jul 23 22:34:39 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:40 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ea454c75-887d-420b-8892-76cd6656dd36 1073741824" returned: 0 in 0.626s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ea454c75-887d-420b-8892-76cd6656dd36 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:40 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ea454c75-887d-420b-8892-76cd6656dd36 Jul 23 22:34:40 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:41 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ea454c75-887d-420b-8892-76cd6656dd36" returned: 0 in 0.540s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:34:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb46681-c4e9-4c04-a87b-62f464e34522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea454c75-887d-420b-8892-76cd6656dd36', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a38431-a4f6-47b0-a67e-a57343aebb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:41 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume volume-ea454c75-887d-420b-8892-76cd6656dd36 (ea454c75-887d-420b-8892-76cd6656dd36): created successfully Jul 23 22:34:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a38431-a4f6-47b0-a67e-a57343aebb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Flow 'volume_create_manager' (12a182c4-b913-4f79-8b29-e215bceffee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:41 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e5db6cdd-608e-49f5-9192-eaf31952a491 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Created volume successfully. Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Flow 'volume_create_manager' (aa69f25e-c2b3-496a-b7a3-b57b71c57e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497f88e1-91a2-4b09-acf7-49ad63dfd07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497f88e1-91a2-4b09-acf7-49ad63dfd07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1083471340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307932ad9b804a0ba496ac43ad3cc565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:43Z,use_quota=True,user_id='767b6ba61d8e4502bff348a23126260a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40db9d14-9c66-4eeb-906f-243ebdfcd3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40db9d14-9c66-4eeb-906f-243ebdfcd3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e84f15d9-b5fe-4d48-9d99-4f0d253c5a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e84f15d9-b5fe-4d48-9d99-4f0d253c5a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7', 'volume_name': 'volume-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba67fc1-25e4-429d-96a4-c12288e8c155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba67fc1-25e4-429d-96a4-c12288e8c155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4cc2539-547a-45b6-9efe-20826eb9c09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:42 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7', 'volume_size': 1} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1083471340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307932ad9b804a0ba496ac43ad3cc565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:43Z,use_quota=True,user_id='767b6ba61d8e4502bff348a23126260a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Creating volume e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:34:42 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:34:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:42 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7 1073741824 Jul 23 22:34:42 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:43 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7 1073741824" returned: 0 in 0.654s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Flow 'volume_create_manager' (04adaa13-d83e-4405-9850-c8ca95e62d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d788d08e-9265-4271-9807-a818c8b996d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d788d08e-9265-4271-9807-a818c8b996d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1364099312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7c57d1-3c45-476f-9fd5-e3bd67fe202c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307932ad9b804a0ba496ac43ad3cc565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:43Z,use_quota=True,user_id='767b6ba61d8e4502bff348a23126260a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74b27d5-fa7b-4906-bf86-dd0ad641ea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74b27d5-fa7b-4906-bf86-dd0ad641ea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:43 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7 Jul 23 22:34:43 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f52758c-6db1-4064-b928-1c39d7bd5828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f52758c-6db1-4064-b928-1c39d7bd5828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb7c57d1-3c45-476f-9fd5-e3bd67fe202c', 'volume_name': 'volume-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc36ba83-d228-4eb4-b135-330690ab00f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc36ba83-d228-4eb4-b135-330690ab00f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb076e2-0bce-448b-998b-0ce78a164067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:43 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume cb7c57d1-3c45-476f-9fd5-e3bd67fe202c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c', 'volume_size': 1} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Flow 'volume_create_manager' (1869377c-6ca8-4e28-bf4a-147f4b36c1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8253a8d-cee3-467d-8dae-8672790f10de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8253a8d-cee3-467d-8dae-8672790f10de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1265499775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ec684e-b0bb-47b2-9e57-6ccbccfc4670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307932ad9b804a0ba496ac43ad3cc565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:44Z,use_quota=True,user_id='767b6ba61d8e4502bff348a23126260a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:43 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b2c91b-1b2d-4333-9929-135b731f329b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b2c91b-1b2d-4333-9929-135b731f329b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db5171f-6fb4-4625-befe-80a8700f33a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db5171f-6fb4-4625-befe-80a8700f33a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ec684e-b0bb-47b2-9e57-6ccbccfc4670', 'volume_name': 'volume-64ec684e-b0bb-47b2-9e57-6ccbccfc4670', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3daeac5d-5a38-4f27-b862-0eab1752ccfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3daeac5d-5a38-4f27-b862-0eab1752ccfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de62f13b-cbd4-413b-a25b-5174ee5cb324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:43 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume 64ec684e-b0bb-47b2-9e57-6ccbccfc4670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ec684e-b0bb-47b2-9e57-6ccbccfc4670', 'volume_size': 1} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7" returned: 0 in 0.454s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.329s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1364099312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7c57d1-3c45-476f-9fd5-e3bd67fe202c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307932ad9b804a0ba496ac43ad3cc565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:43Z,use_quota=True,user_id='767b6ba61d8e4502bff348a23126260a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Creating volume cb7c57d1-3c45-476f-9fd5-e3bd67fe202c {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:34:43 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4cc2539-547a-45b6-9efe-20826eb9c09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8efbde-8932-4c6a-a277-06503d2d5fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:44 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c 1073741824 Jul 23 22:34:44 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume volume-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7 (e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7): created successfully Jul 23 22:34:44 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8efbde-8932-4c6a-a277-06503d2d5fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Flow 'volume_create_manager' (aa69f25e-c2b3-496a-b7a3-b57b71c57e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:44 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b4c8a76e-3813-4977-afc2-665fab580364 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Created volume successfully. Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Flow 'volume_create_manager' (fea3a2d8-9182-45ac-9cc8-6516e5a2ed84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b08bd6-ee0b-4d01-8699-27162b9119d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b08bd6-ee0b-4d01-8699-27162b9119d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-21180842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3e1e67-02c8-4799-aa36-70504b29a876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307932ad9b804a0ba496ac43ad3cc565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:44Z,use_quota=True,user_id='767b6ba61d8e4502bff348a23126260a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd578ae-5d51-4565-8c57-bf0981cbb8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd578ae-5d51-4565-8c57-bf0981cbb8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fca62d-b99d-43c2-a6c9-85396cadbf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fca62d-b99d-43c2-a6c9-85396cadbf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a3e1e67-02c8-4799-aa36-70504b29a876', 'volume_name': 'volume-8a3e1e67-02c8-4799-aa36-70504b29a876', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785db7b8-db29-4f83-99a6-04d893e21242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785db7b8-db29-4f83-99a6-04d893e21242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10184f19-a099-42c2-89a5-fda402e80779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:44 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume 8a3e1e67-02c8-4799-aa36-70504b29a876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a3e1e67-02c8-4799-aa36-70504b29a876', 'volume_size': 1} Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:44 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c 1073741824" returned: 0 in 0.793s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:44 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c Jul 23 22:34:44 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Flow 'volume_create_manager' (b0928cc9-4d6c-431c-862e-7add6beb6a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761c21c5-2e0f-42d3-a176-73b4650757c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761c21c5-2e0f-42d3-a176-73b4650757c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1842745994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b1182d-ab51-4fc1-a013-a74106c864cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307932ad9b804a0ba496ac43ad3cc565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:45Z,use_quota=True,user_id='767b6ba61d8e4502bff348a23126260a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba4cd82-92d8-42ef-b747-80ea65afda45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba4cd82-92d8-42ef-b747-80ea65afda45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5860b5ea-e43b-401f-843d-e056e99f6220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5860b5ea-e43b-401f-843d-e056e99f6220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b1182d-ab51-4fc1-a013-a74106c864cc', 'volume_name': 'volume-09b1182d-ab51-4fc1-a013-a74106c864cc', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ac4ad5-cd80-4b3b-a17c-068fe28e3c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ac4ad5-cd80-4b3b-a17c-068fe28e3c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690f5d3d-f922-4a5d-98d9-de7dc482c7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:45 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume 09b1182d-ab51-4fc1-a013-a74106c864cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b1182d-ab51-4fc1-a013-a74106c864cc', 'volume_size': 1} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:45 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c" returned: 0 in 0.306s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.213s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1265499775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ec684e-b0bb-47b2-9e57-6ccbccfc4670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307932ad9b804a0ba496ac43ad3cc565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:44Z,use_quota=True,user_id='767b6ba61d8e4502bff348a23126260a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Creating volume 64ec684e-b0bb-47b2-9e57-6ccbccfc4670 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:34:45 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-64ec684e-b0bb-47b2-9e57-6ccbccfc4670 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb076e2-0bce-448b-998b-0ce78a164067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26963813-870d-4191-8553-ce30ef6c3394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:45 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-64ec684e-b0bb-47b2-9e57-6ccbccfc4670 1073741824 Jul 23 22:34:45 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:45 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume volume-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c (cb7c57d1-3c45-476f-9fd5-e3bd67fe202c): created successfully Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26963813-870d-4191-8553-ce30ef6c3394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Flow 'volume_create_manager' (04adaa13-d83e-4405-9850-c8ca95e62d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:45 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e68f9c64-e72f-4614-8b3c-b3547bfb31df tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Created volume successfully. Jul 23 22:34:45 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-64ec684e-b0bb-47b2-9e57-6ccbccfc4670 1073741824" returned: 0 in 0.565s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-64ec684e-b0bb-47b2-9e57-6ccbccfc4670 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:45 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-64ec684e-b0bb-47b2-9e57-6ccbccfc4670 Jul 23 22:34:45 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:46 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-64ec684e-b0bb-47b2-9e57-6ccbccfc4670" returned: 0 in 0.314s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.504s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-21180842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3e1e67-02c8-4799-aa36-70504b29a876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307932ad9b804a0ba496ac43ad3cc565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:44Z,use_quota=True,user_id='767b6ba61d8e4502bff348a23126260a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Creating volume 8a3e1e67-02c8-4799-aa36-70504b29a876 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:34:46 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8a3e1e67-02c8-4799-aa36-70504b29a876 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de62f13b-cbd4-413b-a25b-5174ee5cb324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ec684e-b0bb-47b2-9e57-6ccbccfc4670', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93123ae7-7c01-4d16-b5c7-328812ffe2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:46 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8a3e1e67-02c8-4799-aa36-70504b29a876 1073741824 Jul 23 22:34:46 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:46 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume volume-64ec684e-b0bb-47b2-9e57-6ccbccfc4670 (64ec684e-b0bb-47b2-9e57-6ccbccfc4670): created successfully Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93123ae7-7c01-4d16-b5c7-328812ffe2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Flow 'volume_create_manager' (1869377c-6ca8-4e28-bf4a-147f4b36c1bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:46 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a9977c0e-e8d4-4ea7-ba74-76a062400271 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Created volume successfully. Jul 23 22:34:46 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8a3e1e67-02c8-4799-aa36-70504b29a876 1073741824" returned: 0 in 0.588s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8a3e1e67-02c8-4799-aa36-70504b29a876 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:46 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8a3e1e67-02c8-4799-aa36-70504b29a876 Jul 23 22:34:46 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:47 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8a3e1e67-02c8-4799-aa36-70504b29a876" returned: 0 in 0.328s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.954s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1842745994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b1182d-ab51-4fc1-a013-a74106c864cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307932ad9b804a0ba496ac43ad3cc565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:34:45Z,use_quota=True,user_id='767b6ba61d8e4502bff348a23126260a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Creating volume 09b1182d-ab51-4fc1-a013-a74106c864cc {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:34:47 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-09b1182d-ab51-4fc1-a013-a74106c864cc 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10184f19-a099-42c2-89a5-fda402e80779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3e1e67-02c8-4799-aa36-70504b29a876', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5130045-5226-4e95-bf3d-26c895f3735b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:47 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-09b1182d-ab51-4fc1-a013-a74106c864cc 1073741824 Jul 23 22:34:47 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:47 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume volume-8a3e1e67-02c8-4799-aa36-70504b29a876 (8a3e1e67-02c8-4799-aa36-70504b29a876): created successfully Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5130045-5226-4e95-bf3d-26c895f3735b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Flow 'volume_create_manager' (fea3a2d8-9182-45ac-9cc8-6516e5a2ed84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:47 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-747be4e2-e2d4-42d6-ba00-222ab9c3ccc1 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Created volume successfully. Jul 23 22:34:47 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-09b1182d-ab51-4fc1-a013-a74106c864cc 1073741824" returned: 0 in 0.606s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-09b1182d-ab51-4fc1-a013-a74106c864cc {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:47 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-09b1182d-ab51-4fc1-a013-a74106c864cc Jul 23 22:34:47 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:48 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-09b1182d-ab51-4fc1-a013-a74106c864cc" returned: 0 in 0.258s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:34:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690f5d3d-f922-4a5d-98d9-de7dc482c7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b1182d-ab51-4fc1-a013-a74106c864cc', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc850a4-4660-407b-a7f7-fa0c0d17a73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:34:48 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Volume volume-09b1182d-ab51-4fc1-a013-a74106c864cc (09b1182d-ab51-4fc1-a013-a74106c864cc): created successfully Jul 23 22:34:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc850a4-4660-407b-a7f7-fa0c0d17a73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:34:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Flow 'volume_create_manager' (b0928cc9-4d6c-431c-862e-7add6beb6a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:34:48 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a5586f72-0c4a-4642-84e9-9e64a6c45af9 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Created volume successfully. Jul 23 22:34:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "cinder-09b1182d-ab51-4fc1-a013-a74106c864cc-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-09b1182d-ab51-4fc1-a013-a74106c864cc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "cinder-quobyte-09b1182d-ab51-4fc1-a013-a74106c864cc" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-quobyte-09b1182d-ab51-4fc1-a013-a74106c864cc" acquired by "delete_volume" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:48 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c57bc38-d2a4-44ee-8697-3ce0905f58d9]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-09b1182d-ab51-4fc1-a013-a74106c864cc {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:48 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-09b1182d-ab51-4fc1-a013-a74106c864cc Jul 23 22:34:48 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:49 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-09b1182d-ab51-4fc1-a013-a74106c864cc" returned: 0 in 0.385s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-09b1182d-ab51-4fc1-a013-a74106c864cc {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:49 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-09b1182d-ab51-4fc1-a013-a74106c864cc Jul 23 22:34:49 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:49 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-09b1182d-ab51-4fc1-a013-a74106c864cc" returned: 0 in 0.259s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-quobyte-09b1182d-ab51-4fc1-a013-a74106c864cc" released by "delete_volume" :: held 0.688s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Created reservations ['1bfe06ba-503a-4d33-959d-371f89586418', '1edef4e0-9c60-4f54-9c3d-4c28a1a9f61b', '83311d89-6318-4578-ac78-c1bf5e1791b1', 'bb363aba-59d1-4027-b29b-7a8820128a6e'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:49 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:34:49 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:49 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.273s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "cinder-8a3e1e67-02c8-4799-aa36-70504b29a876-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:49 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Deleted volume successfully. Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-8a3e1e67-02c8-4799-aa36-70504b29a876-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8a2fd1c7-fd17-4aba-8722-545f8b30656a tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-09b1182d-ab51-4fc1-a013-a74106c864cc-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "cinder-quobyte-8a3e1e67-02c8-4799-aa36-70504b29a876" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-quobyte-8a3e1e67-02c8-4799-aa36-70504b29a876" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[258257cf-430a-488b-a041-b095caaeda81]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8a3e1e67-02c8-4799-aa36-70504b29a876 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:49 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8a3e1e67-02c8-4799-aa36-70504b29a876 Jul 23 22:34:49 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:50 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8a3e1e67-02c8-4799-aa36-70504b29a876" returned: 0 in 0.387s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8a3e1e67-02c8-4799-aa36-70504b29a876 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:50 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8a3e1e67-02c8-4799-aa36-70504b29a876 Jul 23 22:34:50 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:50 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8a3e1e67-02c8-4799-aa36-70504b29a876" returned: 0 in 0.254s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-quobyte-8a3e1e67-02c8-4799-aa36-70504b29a876" released by "delete_volume" :: held 0.690s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:50 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Created reservations ['45507fb2-d8ee-4659-9caa-c3e457b6672c', '0044c45a-8808-4363-965a-219d49f338bc', '9b241d53-e808-441a-872b-aa2852b37c38', 'ec7f694f-d50c-4f07-86e0-e700aa5e3e2b'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:34:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:50 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:34:50 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:50 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "cinder-64ec684e-b0bb-47b2-9e57-6ccbccfc4670-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.268s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:50 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:34:50 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Deleted volume successfully. Jul 23 22:34:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-64ec684e-b0bb-47b2-9e57-6ccbccfc4670-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-867e1cad-0c3a-4154-b80e-cdf287680f68 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-8a3e1e67-02c8-4799-aa36-70504b29a876-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "cinder-quobyte-64ec684e-b0bb-47b2-9e57-6ccbccfc4670" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-quobyte-64ec684e-b0bb-47b2-9e57-6ccbccfc4670" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:51 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[18485059-e0a3-46bf-97a6-6ca50b1451af]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-64ec684e-b0bb-47b2-9e57-6ccbccfc4670 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:51 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-64ec684e-b0bb-47b2-9e57-6ccbccfc4670 Jul 23 22:34:51 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:51 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-64ec684e-b0bb-47b2-9e57-6ccbccfc4670" returned: 0 in 0.376s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-64ec684e-b0bb-47b2-9e57-6ccbccfc4670 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:51 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-64ec684e-b0bb-47b2-9e57-6ccbccfc4670 Jul 23 22:34:51 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:51 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-64ec684e-b0bb-47b2-9e57-6ccbccfc4670" returned: 0 in 0.244s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-quobyte-64ec684e-b0bb-47b2-9e57-6ccbccfc4670" released by "delete_volume" :: held 0.665s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:51 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Created reservations ['e59a1a5f-d2ec-4145-a166-7779583f0c2d', '10da1808-f74c-48b0-bb1b-0083193070c3', '10e1174e-3d44-4df8-88e8-2178203f9c95', '9014c457-eb4b-404a-9fe9-67d4ec35c589'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:34:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:51 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:51 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:51 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:34:51 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:52 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.239s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:52 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:34:52 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Deleted volume successfully. Jul 23 22:34:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-bc4476b6-a9a5-41d6-9935-abccd9dcab75 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-64ec684e-b0bb-47b2-9e57-6ccbccfc4670-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "cinder-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "cinder-quobyte-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-quobyte-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c" acquired by "delete_volume" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:52 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b252b2c0-37ea-4a51-99a4-5bc369190b87]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:52 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c Jul 23 22:34:52 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:52 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c" returned: 0 in 0.409s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:52 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c Jul 23 22:34:52 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:52 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c" returned: 0 in 0.261s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-quobyte-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c" released by "delete_volume" :: held 0.729s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:52 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Created reservations ['bfdfbaf8-59e7-4d05-9193-32c051983e86', 'b677bb49-6077-425e-9515-254119fa7384', 'b64df5ea-4973-448e-9142-9802217bc256', '4202d1e7-ddd4-42c6-9a1f-9369bf943e01'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:53 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:34:53 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "cinder-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:53 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.284s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:34:53 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Deleted volume successfully. Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "cinder-quobyte-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-quobyte-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7" acquired by "delete_volume" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e9df0e90-96a5-477c-8bd9-6fa266b97fe5 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-cb7c57d1-3c45-476f-9fd5-e3bd67fe202c-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[86febbe0-2b29-4ca3-b239-8a8e2c9cb963]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:53 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7 Jul 23 22:34:53 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:53 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7" returned: 0 in 0.345s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:53 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7 Jul 23 22:34:53 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:53 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7" returned: 0 in 0.244s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-quobyte-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7" released by "delete_volume" :: held 0.636s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Created reservations ['3703610c-32f6-4ada-8d7f-dce77c613237', 'fa69f565-e431-4c75-9ceb-c1dffffa66f4', '5ce3f76a-7377-49bd-90f5-efc6ef12eb7a', 'cec8c537-dd68-4723-99f0-1dc6ec0d7d5b'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:54 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:34:54 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:54 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.245s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:34:54 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Deleted volume successfully. Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f9f2fed6-4b17-4a38-b7e6-03b351a04021 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-e6e916c8-bdc7-4fbd-b127-2a5f0594e9b7-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "cinder-ea454c75-887d-420b-8892-76cd6656dd36-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-ea454c75-887d-420b-8892-76cd6656dd36-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "cinder-quobyte-ea454c75-887d-420b-8892-76cd6656dd36" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-quobyte-ea454c75-887d-420b-8892-76cd6656dd36" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cc3027-8f48-4fe3-9fa2-7bd0edc78dd5]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ea454c75-887d-420b-8892-76cd6656dd36 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:54 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ea454c75-887d-420b-8892-76cd6656dd36 Jul 23 22:34:54 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:54 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ea454c75-887d-420b-8892-76cd6656dd36" returned: 0 in 0.358s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ea454c75-887d-420b-8892-76cd6656dd36 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:54 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ea454c75-887d-420b-8892-76cd6656dd36 Jul 23 22:34:54 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:55 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ea454c75-887d-420b-8892-76cd6656dd36" returned: 0 in 0.248s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-quobyte-ea454c75-887d-420b-8892-76cd6656dd36" released by "delete_volume" :: held 0.643s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:34:55 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Created reservations ['85d47116-cd7a-4f4b-92c8-0187b095843a', '76816518-3444-4413-9475-11eb22c34800', '68dccae2-3ff0-4122-b559-13d2ff8af146', '430a1fbc-fb0e-4cce-8479-d8c064eb4a13'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:34:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:34:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:34:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:34:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:34:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:34:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:34:55 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:34:55 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:34:55 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 23 22:34:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.239s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:34:55 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:34:55 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Deleted volume successfully. Jul 23 22:34:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0ca111d1-c95e-4088-af63-4c4d58daf9e7 tempest-CreateVolumesFromSourceVolumeTest-978817514 None] Lock "cinder-ea454c75-887d-420b-8892-76cd6656dd36-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:35:01 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=119,cinder:UPDATE=155,cinder:INSERT=43,cinder:DELETE=14 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:35:01 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=121,cinder:UPDATE=168,cinder:INSERT=40,cinder:DELETE=13 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:35:23 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-8142c9e7-903f-452b-9506-e63035c31999 req-adb2ae6f-9f5d-4c37-9988-269bc2d0ec24 tempest-TestMinimumBasicScenario-1818597862 None] Terminate volume connection completed successfully. Jul 23 22:35:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-8142c9e7-903f-452b-9506-e63035c31999 req-adb2ae6f-9f5d-4c37-9988-269bc2d0ec24 tempest-TestMinimumBasicScenario-1818597862 None] Deleting attachment dd3cb0f5-5eb1-47d2-bbbd-bb8ed3a0bfe1. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:35:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Acquiring lock "cinder-6116c29c-bd69-446d-b580-a29531fb94e0-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:35:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Lock "cinder-6116c29c-bd69-446d-b580-a29531fb94e0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:35:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Acquiring lock "cinder-quobyte-6116c29c-bd69-446d-b580-a29531fb94e0" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:35:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Lock "cinder-quobyte-6116c29c-bd69-446d-b580-a29531fb94e0" acquired by "delete_volume" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:35:24 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3e65f9-2aed-4d4b-a50e-9f8e161ac673]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:35:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6116c29c-bd69-446d-b580-a29531fb94e0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:35:24 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6116c29c-bd69-446d-b580-a29531fb94e0 Jul 23 22:35:24 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:35:24 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 23 22:35:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6116c29c-bd69-446d-b580-a29531fb94e0" returned: 0 in 0.352s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:35:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6116c29c-bd69-446d-b580-a29531fb94e0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:35:24 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6116c29c-bd69-446d-b580-a29531fb94e0 Jul 23 22:35:24 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:35:25 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 23 22:35:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6116c29c-bd69-446d-b580-a29531fb94e0" returned: 0 in 0.239s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:35:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Lock "cinder-quobyte-6116c29c-bd69-446d-b580-a29531fb94e0" released by "delete_volume" :: held 0.635s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:35:25 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Created reservations ['ba30dd1f-736a-41c4-9137-5125b8af6ed5', '3346d551-e00d-4b3e-81f2-59b28a75fac4', 'd5274dbf-93ea-46eb-b681-4a20a0f3638c', '09aa8284-c133-4001-8334-a7bb94e27448'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:35:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:35:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:35:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:35:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:35:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:35:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:35:25 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:35:25 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:35:25 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 23 22:35:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.246s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:35:25 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:35:25 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Deleted volume successfully. Jul 23 22:35:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-08fcc2bf-8bae-49fd-90be-6df4aa412ff5 tempest-TestMinimumBasicScenario-1818597862 None] Lock "cinder-6116c29c-bd69-446d-b580-a29531fb94e0-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:35:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:35:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:35:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:35:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:35:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:35:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:35:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:35:26 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:35:26 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:35:26 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 23 22:35:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.283s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:35:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:35:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:35:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 29 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:35:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:35:35 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:35:35 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:26 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:36:26 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:26 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.258s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 29 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Flow 'volume_create_manager' (99e9363e-e90e-4a21-b3b9-14f16719c806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb1f8a2-f2dd-4509-8479-2ccdfcc4d8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb1f8a2-f2dd-4509-8479-2ccdfcc4d8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1033160972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49cd1ae-f05f-4852-8495-9d94f3df2e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e59478441e4ddd9a70d8406c7c3caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:36:26Z,use_quota=True,user_id='9ef0c5f8aba84f5bacddc3bf1c94cb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9248dd9-c5a5-4f58-9af4-b11460f670fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9248dd9-c5a5-4f58-9af4-b11460f670fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270bd42e-e53f-4fc5-b3b7-34b39a9e3a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270bd42e-e53f-4fc5-b3b7-34b39a9e3a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b49cd1ae-f05f-4852-8495-9d94f3df2e8d', 'volume_name': 'volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f7bdf3-84be-4a8e-95ce-422a916c0604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f7bdf3-84be-4a8e-95ce-422a916c0604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3c6605-71a9-44cb-964c-a1d526c3b678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:26 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Volume b49cd1ae-f05f-4852-8495-9d94f3df2e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d', 'volume_size': 1} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1033160972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49cd1ae-f05f-4852-8495-9d94f3df2e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e59478441e4ddd9a70d8406c7c3caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:36:26Z,use_quota=True,user_id='9ef0c5f8aba84f5bacddc3bf1c94cb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Creating volume b49cd1ae-f05f-4852-8495-9d94f3df2e8d {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:36:26 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:26 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d 1073741824 Jul 23 22:36:26 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:26 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d 1073741824" returned: 0 in 0.394s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:27 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d Jul 23 22:36:27 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:27 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d" returned: 0 in 0.235s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:36:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:36:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3c6605-71a9-44cb-964c-a1d526c3b678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b422bc54-8a93-4ac0-a08e-954b557ff60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:27 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Volume volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d (b49cd1ae-f05f-4852-8495-9d94f3df2e8d): created successfully Jul 23 22:36:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b422bc54-8a93-4ac0-a08e-954b557ff60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Flow 'volume_create_manager' (99e9363e-e90e-4a21-b3b9-14f16719c806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:36:27 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-62442dc2-0422-488b-831e-4217de2ecb40 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Created volume successfully. Jul 23 22:36:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-4ff82dbc-5edf-470c-9f5f-64fea72a5f19 req-0463982b-7da4-4c5b-b787-14d1ec3a4818 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:36:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-4ff82dbc-5edf-470c-9f5f-64fea72a5f19 req-0463982b-7da4-4c5b-b787-14d1ec3a4818 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:36:28 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[baddbdc2-515e-49b9-b000-2e1e461149fd]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:36:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-4ff82dbc-5edf-470c-9f5f-64fea72a5f19 req-0463982b-7da4-4c5b-b787-14d1ec3a4818 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:28 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d Jul 23 22:36:28 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:28 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [req-4ff82dbc-5edf-470c-9f5f-64fea72a5f19 req-0463982b-7da4-4c5b-b787-14d1ec3a4818 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d" returned: 0 in 0.345s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [req-4ff82dbc-5edf-470c-9f5f-64fea72a5f19 req-0463982b-7da4-4c5b-b787-14d1ec3a4818 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.360s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:36:28 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-4ff82dbc-5edf-470c-9f5f-64fea72a5f19 req-0463982b-7da4-4c5b-b787-14d1ec3a4818 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190', 'name': 'volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3427fe00-b12d-4341-b980-af5ff08bafd0', 'enforce_multipath': True} {{(pid=88308) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 23 22:36:28 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-4ff82dbc-5edf-470c-9f5f-64fea72a5f19 req-0463982b-7da4-4c5b-b787-14d1ec3a4818 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] attachment_update completed successfully. Jul 23 22:36:31 devstack cinder-volume[88308]: INFO cinder.volume.manager [req-3982cb46-1ad7-41ce-8e5d-e79647ac7f9e req-183ea38c-7a0f-4cba-8c13-ea77d1b7f7a3 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Terminate volume connection completed successfully. Jul 23 22:36:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [req-3982cb46-1ad7-41ce-8e5d-e79647ac7f9e req-183ea38c-7a0f-4cba-8c13-ea77d1b7f7a3 tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Deleting attachment 3427fe00-b12d-4341-b980-af5ff08bafd0. {{(pid=88308) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 23 22:36:32 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Acquiring lock "cinder-b49cd1ae-f05f-4852-8495-9d94f3df2e8d-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:36:32 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Lock "cinder-b49cd1ae-f05f-4852-8495-9d94f3df2e8d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:36:32 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Acquiring lock "cinder-quobyte-b49cd1ae-f05f-4852-8495-9d94f3df2e8d" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:36:32 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Lock "cinder-quobyte-b49cd1ae-f05f-4852-8495-9d94f3df2e8d" acquired by "delete_volume" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:36:32 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[95aae188-8525-4282-a7ac-e78976ff5677]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:36:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:32 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d Jul 23 22:36:32 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:32 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d" returned: 0 in 0.348s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:32 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d Jul 23 22:36:32 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:32 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b49cd1ae-f05f-4852-8495-9d94f3df2e8d" returned: 0 in 0.237s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:32 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Lock "cinder-quobyte-b49cd1ae-f05f-4852-8495-9d94f3df2e8d" released by "delete_volume" :: held 0.621s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:36:32 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Created reservations ['2bee641c-bde3-4d59-b18e-ee53e29cbf9b', 'cb3c5e8c-e275-4838-afec-a3264a43fea3', '5fc35143-8ce3-4177-ad4b-d66310d4d6c8', '2d7e8017-ddb5-4d81-ac5d-4da19eb55694'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:36:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:36:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:36:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:36:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:36:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:36:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:33 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:36:33 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:33 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.240s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:33 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:36:33 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Deleted volume successfully. Jul 23 22:36:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3c9d6734-bfc3-48f6-8c40-fbfab0bcb40d tempest-TestServerVolumeAttachScenarioOldVersion-64144984 None] Lock "cinder-b49cd1ae-f05f-4852-8495-9d94f3df2e8d-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:36:42 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=11,cinder:UPDATE=15,cinder:INSERT=1 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:36:43 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:UPDATE=10,cinder:SELECT=16,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Flow 'volume_create_manager' (a2aff4fa-6042-40d2-bf00-13c0834e2a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a6db54-9dc9-4cf5-a78c-c47b246e2948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a6db54-9dc9-4cf5-a78c-c47b246e2948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1960938235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96e5602afc94a68918fe698bc5e07d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:36:46Z,use_quota=True,user_id='37f78a2fa4c3457081d534bfb9e3f1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c226edbb-8bc4-4434-8739-f160b20d524b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c226edbb-8bc4-4434-8739-f160b20d524b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71f6541-3c02-49ee-9b95-3d98eb53a734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71f6541-3c02-49ee-9b95-3d98eb53a734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c', 'volume_name': 'volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1e69ee-d83e-474b-a5b6-5245c90f33c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1e69ee-d83e-474b-a5b6-5245c90f33c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e444fb34-b38a-442d-9180-047379bfe301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:46 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Volume 8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c', 'volume_size': 1} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1960938235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96e5602afc94a68918fe698bc5e07d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:36:46Z,use_quota=True,user_id='37f78a2fa4c3457081d534bfb9e3f1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Creating volume 8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:36:46 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:46 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c 1073741824 Jul 23 22:36:46 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:46 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c 1073741824" returned: 0 in 0.405s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:46 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c Jul 23 22:36:46 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:47 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c" returned: 0 in 0.238s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:36:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:36:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e444fb34-b38a-442d-9180-047379bfe301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3598aa62-b17c-47a8-91c9-b488abf59731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:47 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Volume volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c (8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c): created successfully Jul 23 22:36:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3598aa62-b17c-47a8-91c9-b488abf59731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Flow 'volume_create_manager' (a2aff4fa-6042-40d2-bf00-13c0834e2a09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:36:47 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-0e89c3b8-ee7b-421f-9a50-31121752441e tempest-VolumeDependencyTests-637475841 None] Created volume successfully. Jul 23 22:36:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:36:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:36:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] Creating offline snapshot 5e7aa5f4-9663-4316-beb9-0c09288cd5c3 of volume 8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:36:47 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c43a8d-d41f-43d4-a61d-1945c7f3b9c2]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:36:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:47 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c Jul 23 22:36:47 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:47 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c" returned: 0 in 0.353s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:47 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 1G Jul 23 22:36:47 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:48 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 1G" returned: 0 in 0.375s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:48 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 Jul 23 22:36:48 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:48 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3" returned: 0 in 0.280s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:48 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 is being set with open permissions: ugo+rw Jul 23 22:36:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:48 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 Jul 23 22:36:48 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:48 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3" returned: 0 in 0.241s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:48 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.info Jul 23 22:36:48 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:49 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.info" returned: 0 in 0.256s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:49 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.info is being set with open permissions: ugo+rw Jul 23 22:36:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:49 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.info Jul 23 22:36:49 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:49 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.info" returned: 0 in 0.234s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:36:49 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-8504507e-bd14-4a95-930c-eb6db948a034 tempest-VolumeDependencyTests-637475841 None] Create snapshot completed successfully Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Flow 'volume_create_manager' (27a1bc53-fac2-40bd-9ba8-f734f6d91d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e8fa1a-90db-40f1-8690-ed3ca9daa3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e8fa1a-90db-40f1-8690-ed3ca9daa3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-648134841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9bbdee2-2b8f-49cd-ba71-7087c1969206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96e5602afc94a68918fe698bc5e07d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5e7aa5f4-9663-4316-beb9-0c09288cd5c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:36:50Z,use_quota=True,user_id='37f78a2fa4c3457081d534bfb9e3f1ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719213fc-f9c6-424f-9469-735e1e826e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719213fc-f9c6-424f-9469-735e1e826e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6672828a-4a9e-4a1c-a37d-2db65f25874c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6672828a-4a9e-4a1c-a37d-2db65f25874c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a9bbdee2-2b8f-49cd-ba71-7087c1969206', 'volume_name': 'volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206', 'volume_size': 1, 'snapshot_id': '5e7aa5f4-9663-4316-beb9-0c09288cd5c3'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87ae43c-5b6b-4c34-9426-85c35ec623a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87ae43c-5b6b-4c34-9426-85c35ec623a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd863e69-c6ef-49e3-afd7-e37f9a0e2271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:50 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Volume a9bbdee2-2b8f-49cd-ba71-7087c1969206: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206', 'volume_size': 1, 'snapshot_id': '5e7aa5f4-9663-4316-beb9-0c09288cd5c3'} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Acquiring lock "cinder-quobyte-5e7aa5f4-9663-4316-beb9-0c09288cd5c3-a9bbdee2-2b8f-49cd-ba71-7087c1969206" by "_create_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Lock "cinder-quobyte-5e7aa5f4-9663-4316-beb9-0c09288cd5c3-a9bbdee2-2b8f-49cd-ba71-7087c1969206" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Creating volume a9bbdee2-2b8f-49cd-ba71-7087c1969206 from snapshot 5e7aa5f4-9663-4316-beb9-0c09288cd5c3 {{(pid=88308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Acquiring lock "cinder-quobyte-a9bbdee2-2b8f-49cd-ba71-7087c1969206" by "_copy_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Lock "cinder-quobyte-a9bbdee2-2b8f-49cd-ba71-7087c1969206" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] snapshot: 5e7aa5f4-9663-4316-beb9-0c09288cd5c3, volume: a9bbdee2-2b8f-49cd-ba71-7087c1969206, {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[881c0c61-1789-46e7-804f-196ae6d6ce86]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:50 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 Jul 23 22:36:50 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:50 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3" returned: 0 in 0.343s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Creating direct copy from snapshot {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5255d5ba-75cf-4eb7-8b04-ba389c279d96]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:50 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c Jul 23 22:36:50 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:50 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c" returned: 0 in 0.344s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG cinder.utils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Path /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206 not found in is_blk_device check {{(pid=88308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 22:36:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:50 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206 Jul 23 22:36:50 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:55 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206" returned: 0 in 4.042s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:55 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f1ebb0-e54f-4d36-91e0-ffa9b88558eb]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:36:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:55 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c Jul 23 22:36:55 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:55 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c" returned: 0 in 0.527s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:55 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c, size 1024.00 MB, duration 4.04 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206 {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:36:55 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Converted 1024.00 MB image at 253.23 MB/s Jul 23 22:36:55 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206 is being set with open permissions: ugo+rw Jul 23 22:36:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:55 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206 Jul 23 22:36:55 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:55 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206" returned: 0 in 0.238s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Lock "cinder-quobyte-a9bbdee2-2b8f-49cd-ba71-7087c1969206" released by "_copy_volume_from_snapshot" :: held 5.579s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:36:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Lock "cinder-quobyte-5e7aa5f4-9663-4316-beb9-0c09288cd5c3-a9bbdee2-2b8f-49cd-ba71-7087c1969206" released by "_create_volume_from_snapshot" :: held 5.608s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:36:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.621s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:36:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd863e69-c6ef-49e3-afd7-e37f9a0e2271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206', 'volume_size': 1, 'snapshot_id': '5e7aa5f4-9663-4316-beb9-0c09288cd5c3'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b40f9e9-6578-410a-9c81-8e1f51b5d07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:36:55 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Volume volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206 (a9bbdee2-2b8f-49cd-ba71-7087c1969206): created successfully Jul 23 22:36:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b40f9e9-6578-410a-9c81-8e1f51b5d07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:36:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Flow 'volume_create_manager' (27a1bc53-fac2-40bd-9ba8-f734f6d91d61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:36:55 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a0bc1d70-3630-47ee-890e-e65f20291f47 tempest-VolumeDependencyTests-637475841 None] Created volume successfully. Jul 23 22:36:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Acquiring lock "cinder-5e7aa5f4-9663-4316-beb9-0c09288cd5c3-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:36:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Lock "cinder-5e7aa5f4-9663-4316-beb9-0c09288cd5c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:36:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Acquiring lock "cinder-quobyte-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:36:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Lock "cinder-quobyte-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:36:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Acquiring lock "cinder-quobyte-5e7aa5f4-9663-4316-beb9-0c09288cd5c3" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:36:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Lock "cinder-quobyte-5e7aa5f4-9663-4316-beb9-0c09288cd5c3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:36:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Deleting offline snapshot 5e7aa5f4-9663-4316-beb9-0c09288cd5c3 of volume 8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:36:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] snapshot_file for this snap is: volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:36:56 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdde082c-ff6a-451f-84bd-7db13e09efdd]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:36:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:56 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 Jul 23 22:36:56 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:56 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3" returned: 0 in 0.348s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:36:57 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99d78fb-f82c-412f-9b70-dfe0c6b7eeae]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:36:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:57 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c Jul 23 22:36:57 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:57 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c" returned: 0 in 0.351s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:57 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 Jul 23 22:36:57 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:57 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3" returned: 0 in 0.335s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:57 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3 Jul 23 22:36:57 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:57 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c.5e7aa5f4-9663-4316-beb9-0c09288cd5c3" returned: 0 in 0.243s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Lock "cinder-quobyte-5e7aa5f4-9663-4316-beb9-0c09288cd5c3" released by "_delete_snapshot" :: held 1.370s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:36:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Lock "cinder-quobyte-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c" released by "delete_snapshot" :: held 1.391s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:36:58 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Created reservations ['29087710-32eb-4b93-a2e1-c1f08b0217f4', '1b0c2e8d-e4d1-4906-ad3b-b9961fae6ad2', 'f385d916-1cd5-4a38-a3c1-cc27b23bfa54', '75951002-f985-46cf-ad54-3fe3dacd3d43'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:36:58 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Delete snapshot completed successfully. Jul 23 22:36:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-0c32858e-b671-46cb-a771-e898cecc7d3c tempest-VolumeDependencyTests-637475841 None] Lock "cinder-5e7aa5f4-9663-4316-beb9-0c09288cd5c3-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:36:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Acquiring lock "cinder-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:36:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Lock "cinder-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:36:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Acquiring lock "cinder-quobyte-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:36:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Lock "cinder-quobyte-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:36:58 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[09556bd9-76aa-4c45-93ea-77d12b95b1f4]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:36:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:58 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c Jul 23 22:36:58 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:59 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c" returned: 0 in 0.365s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:59 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c Jul 23 22:36:59 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:59 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c" returned: 0 in 0.245s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Lock "cinder-quobyte-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c" released by "delete_volume" :: held 0.666s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Created reservations ['6f3fd971-9628-444e-844f-6d24038d45a3', 'c9d8de7c-3f5d-48e6-bb14-69dfc0ea0077', '3943f09b-e854-4d1c-8424-52b1d218b287', '5f7c8b3f-f81f-4b11-ac88-5bf1a3d78ba3'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:36:59 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:36:59 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:36:59 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.242s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:36:59 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Deleted volume successfully. Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1cd7c7b4-15da-4302-b059-32f84bb043b6 tempest-VolumeDependencyTests-637475841 None] Lock "cinder-8f43fe4f-fcc8-4f58-86ec-4e8aaadbee9c-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Acquiring lock "cinder-a9bbdee2-2b8f-49cd-ba71-7087c1969206-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Lock "cinder-a9bbdee2-2b8f-49cd-ba71-7087c1969206-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Acquiring lock "cinder-quobyte-a9bbdee2-2b8f-49cd-ba71-7087c1969206" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Lock "cinder-quobyte-a9bbdee2-2b8f-49cd-ba71-7087c1969206" acquired by "delete_volume" :: waited 0.013s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfd8c64-7d42-49ab-853d-e76c8b9f0ec2]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:36:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:00 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206 Jul 23 22:37:00 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:00 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206" returned: 0 in 0.358s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:00 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206 Jul 23 22:37:00 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:00 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a9bbdee2-2b8f-49cd-ba71-7087c1969206" returned: 0 in 0.249s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Lock "cinder-quobyte-a9bbdee2-2b8f-49cd-ba71-7087c1969206" released by "delete_volume" :: held 0.648s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:37:00 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Created reservations ['a502f7f7-7a36-4369-8e7b-89e048a29769', 'e45d4773-dc7a-44f6-961f-c5eeefc32fac', '7de1dcb1-83de-4e19-932f-6a08031b64e5', '58080e7e-6912-46f6-99b1-1fb0715f354c'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:37:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:37:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:37:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:00 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:37:00 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:00 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.239s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:00 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:37:00 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Deleted volume successfully. Jul 23 22:37:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a536bf4a-1b57-4708-b438-417cabcf7845 tempest-VolumeDependencyTests-637475841 None] Lock "cinder-a9bbdee2-2b8f-49cd-ba71-7087c1969206-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:37:05 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:37:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Flow 'volume_create_manager' (48d84eb6-31d4-4cfe-bd68-4029ebd7b572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:37:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0cc3f5-2e61-48ff-8b80-9409408b49ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0cc3f5-2e61-48ff-8b80-9409408b49ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269e554f-f39e-4060-8d7f-49eebd955fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7654c8fd1d4edb92020a31b1c91713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:37:06Z,use_quota=True,user_id='edc268270ec74f2ba5180507f703a55a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c90e67b-5125-4a9e-a850-c375af0b5456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c90e67b-5125-4a9e-a850-c375af0b5456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:05 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20aebc06-5e4a-4793-9adb-070641b5ee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:05 devstack cinder-volume[88308]: DEBUG cinder.image.glance [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Creating Keystone auth plugin from conf {{(pid=88308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 22:37:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20aebc06-5e4a-4793-9adb-070641b5ee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '269e554f-f39e-4060-8d7f-49eebd955fe0', 'volume_name': 'volume-269e554f-f39e-4060-8d7f-49eebd955fe0', 'volume_size': 1, 'image_id': '21c44752-1b5b-4628-a76e-54f755432cce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21c44752-1b5b-4628-a76e-54f755432cce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b5284d39ef11cd3021a20c925271a9e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8b7654c8fd1d4edb92020a31b1c91713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b46b215d46f481f1ed037da3db599a049a09e63a10d31569f6bf769ddf227d3c0363b48297a4c67610c842f5ef30448c4bdbc1b65b78dc3f0e1955acb03abea0', 'id': '21c44752-1b5b-4628-a76e-54f755432cce', 'created_at': datetime.datetime(2026, 7, 23, 20, 37, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 37, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21c44752-1b5b-4628-a76e-54f755432cce/file', 'properties': {}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f398abe-1e95-4d6b-9900-384b06ff2d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f398abe-1e95-4d6b-9900-384b06ff2d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575ab936-7b5a-42f7-8566-5f098156f7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:06 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Volume 269e554f-f39e-4060-8d7f-49eebd955fe0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-269e554f-f39e-4060-8d7f-49eebd955fe0', 'volume_size': 1, 'image_id': '21c44752-1b5b-4628-a76e-54f755432cce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21c44752-1b5b-4628-a76e-54f755432cce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b5284d39ef11cd3021a20c925271a9e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8b7654c8fd1d4edb92020a31b1c91713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b46b215d46f481f1ed037da3db599a049a09e63a10d31569f6bf769ddf227d3c0363b48297a4c67610c842f5ef30448c4bdbc1b65b78dc3f0e1955acb03abea0', 'id': '21c44752-1b5b-4628-a76e-54f755432cce', 'created_at': datetime.datetime(2026, 7, 23, 20, 37, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 37, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21c44752-1b5b-4628-a76e-54f755432cce/file', 'properties': {}}, 'image_service': } Jul 23 22:37:06 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Trying to clone 269e554f-f39e-4060-8d7f-49eebd955fe0 from image 21c44752-1b5b-4628-a76e-54f755432cce at location (None, [{'url': 'file:///opt/stack/data/glance/images/21c44752-1b5b-4628-a76e-54f755432cce', 'metadata': {}}]). {{(pid=88308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 22:37:06 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 22:37:06 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Image download 0.00 MB at 0.00 MB/s Jul 23 22:37:06 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b90206-cc3b-4c01-8ef6-2486df523a7b]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:37:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:06 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD Jul 23 22:37:06 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:06 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD" returned: 0 in 0.317s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:06 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD Jul 23 22:37:06 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:06 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD" returned: 1 in 0.315s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:37:06 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Temporary image 21c44752-1b5b-4628-a76e-54f755432cce is fetched for user edc268270ec74f2ba5180507f703a55a. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[421d0a79-55c5-4f12-bb8b-6c87a24be25d]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:07 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD Jul 23 22:37:07 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:07 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD" returned: 0 in 0.331s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:07 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD Jul 23 22:37:07 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:07 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD" returned: 1 in 0.318s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269e554f-f39e-4060-8d7f-49eebd955fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7654c8fd1d4edb92020a31b1c91713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:37:06Z,use_quota=True,user_id='edc268270ec74f2ba5180507f703a55a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Creating volume 269e554f-f39e-4060-8d7f-49eebd955fe0 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:37:07 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:37:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:07 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 1073741824 Jul 23 22:37:07 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:08 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 1073741824" returned: 0 in 0.404s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:08 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 Jul 23 22:37:08 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:08 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0" returned: 0 in 0.239s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:08 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:37:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:08 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Attempting download of 21c44752-1b5b-4628-a76e-54f755432cce ((None, [{'url': 'file:///opt/stack/data/glance/images/21c44752-1b5b-4628-a76e-54f755432cce', 'metadata': {}}])) to volume 269e554f-f39e-4060-8d7f-49eebd955fe0. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 22:37:08 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda3a25c-bf6e-4bb2-80c4-1c9e14d73e18]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:37:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21c44752-1b5b-4628-a76e-54f755432cce_klanuq0g {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:08 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21c44752-1b5b-4628-a76e-54f755432cce_klanuq0g Jul 23 22:37:08 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:08 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_21c44752-1b5b-4628-a76e-54f755432cce_klanuq0g" returned: 0 in 0.313s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21c44752-1b5b-4628-a76e-54f755432cce_klanuq0g {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:08 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21c44752-1b5b-4628-a76e-54f755432cce_klanuq0g Jul 23 22:37:08 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:09 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21c44752-1b5b-4628-a76e-54f755432cce_klanuq0g" returned: 1 in 0.314s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_21c44752-1b5b-4628-a76e-54f755432cce_klanuq0g' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:37:09 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc7473c-c9db-434e-b9a1-b3b3757f1bd6]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:37:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:09 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD Jul 23 22:37:09 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:09 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD" returned: 0 in 0.315s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:09 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD Jul 23 22:37:09 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:09 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD" returned: 1 in 0.322s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:37:09 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] 21c44752-1b5b-4628-a76e-54f755432cce was raw, converting to raw {{(pid=88308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 22:37:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:09 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 Jul 23 22:37:09 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:10 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0" returned: 0 in 0.320s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:10 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_21c44752-1b5b-4628-a76e-54f755432cce_bsfilk62devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:37:10 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 22:37:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:10 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 1G Jul 23 22:37:10 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:10 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 1G" returned: 0 in 0.268s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:10 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b0e658-4007-42d5-b919-9327323666bb]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:37:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:10 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 Jul 23 22:37:10 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:10 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0" returned: 0 in 0.364s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:10 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 Jul 23 22:37:10 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:11 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0" returned: 1 in 0.344s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:37:11 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Downloaded image 21c44752-1b5b-4628-a76e-54f755432cce ((None, [{'url': 'file:///opt/stack/data/glance/images/21c44752-1b5b-4628-a76e-54f755432cce', 'metadata': {}}])) to volume 269e554f-f39e-4060-8d7f-49eebd955fe0 successfully. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 22:37:11 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Temporary image 21c44752-1b5b-4628-a76e-54f755432cce for user edc268270ec74f2ba5180507f703a55a is deleted. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 22:37:11 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Marking volume 269e554f-f39e-4060-8d7f-49eebd955fe0 as bootable. {{(pid=88308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 22:37:11 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Copying metadata from image 21c44752-1b5b-4628-a76e-54f755432cce to 269e554f-f39e-4060-8d7f-49eebd955fe0. {{(pid=88308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 22:37:11 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Creating volume glance metadata for volume 269e554f-f39e-4060-8d7f-49eebd955fe0 backed by image 21c44752-1b5b-4628-a76e-54f755432cce with: {'image_id': '21c44752-1b5b-4628-a76e-54f755432cce', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6b5284d39ef11cd3021a20c925271a9e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 22:37:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575ab936-7b5a-42f7-8566-5f098156f7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-269e554f-f39e-4060-8d7f-49eebd955fe0', 'volume_size': 1, 'image_id': '21c44752-1b5b-4628-a76e-54f755432cce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/21c44752-1b5b-4628-a76e-54f755432cce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b5284d39ef11cd3021a20c925271a9e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8b7654c8fd1d4edb92020a31b1c91713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b46b215d46f481f1ed037da3db599a049a09e63a10d31569f6bf769ddf227d3c0363b48297a4c67610c842f5ef30448c4bdbc1b65b78dc3f0e1955acb03abea0', 'id': '21c44752-1b5b-4628-a76e-54f755432cce', 'created_at': datetime.datetime(2026, 7, 23, 20, 37, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 37, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/21c44752-1b5b-4628-a76e-54f755432cce/file', 'properties': {}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97422d9e-0c12-40c2-8db4-24a1198c6827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:11 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Volume volume-269e554f-f39e-4060-8d7f-49eebd955fe0 (269e554f-f39e-4060-8d7f-49eebd955fe0): created successfully Jul 23 22:37:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97422d9e-0c12-40c2-8db4-24a1198c6827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Flow 'volume_create_manager' (48d84eb6-31d4-4cfe-bd68-4029ebd7b572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:37:11 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-9539ba8b-b59c-4dc2-8602-c57034803825 tempest-VolumeImageDependencyTests-293214632 None] Created volume successfully. Jul 23 22:37:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Acquiring lock "cinder-269e554f-f39e-4060-8d7f-49eebd955fe0-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:37:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Lock "cinder-269e554f-f39e-4060-8d7f-49eebd955fe0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:37:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Acquiring lock "cinder-quobyte-269e554f-f39e-4060-8d7f-49eebd955fe0" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:37:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Lock "cinder-quobyte-269e554f-f39e-4060-8d7f-49eebd955fe0" acquired by "delete_volume" :: waited 0.013s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:37:12 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[93026c28-42dc-4395-8887-5379bbcf3de2]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:37:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:12 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 Jul 23 22:37:12 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:12 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0" returned: 0 in 0.351s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:12 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 Jul 23 22:37:12 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:13 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0" returned: 1 in 0.344s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:37:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:13 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0 Jul 23 22:37:13 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:13 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-269e554f-f39e-4060-8d7f-49eebd955fe0" returned: 0 in 0.247s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:13 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Lock "cinder-quobyte-269e554f-f39e-4060-8d7f-49eebd955fe0" released by "delete_volume" :: held 1.005s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:37:13 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Created reservations ['3cd28d8d-5aa1-4b6a-8419-0bf86c39db1f', '7f32b00e-de2f-4cb1-a778-c603eefed390', 'ba4af350-0eed-4dea-92d9-666d7893986e', '84442aab-b5c1-4622-aa7b-4b1e507b0b1a'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:37:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:37:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:37:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:13 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:37:13 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:13 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.246s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:13 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:37:13 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Deleted volume successfully. Jul 23 22:37:13 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47f7b77c-4e43-4533-8d96-b413123e4f52 tempest-VolumeImageDependencyTests-293214632 None] Lock "cinder-269e554f-f39e-4060-8d7f-49eebd955fe0-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Flow 'volume_create_manager' (3869b78d-6b12-4f35-94a5-881f32bff851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5427461f-2978-4128-b9e0-83c8cd895875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5427461f-2978-4128-b9e0-83c8cd895875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65db3972-07cc-4c49-81eb-9f62cdcf1355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df5c3fdb8944d1fa05d4b2449ffd3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:37:17Z,use_quota=True,user_id='f2f218db193c41a0981315ad45e40021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e851add-735e-4bf1-8864-dc3130d7dcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e851add-735e-4bf1-8864-dc3130d7dcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d72263-f932-4f0b-8b1f-a4dc3dd7440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d72263-f932-4f0b-8b1f-a4dc3dd7440d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65db3972-07cc-4c49-81eb-9f62cdcf1355', 'volume_name': 'volume-65db3972-07cc-4c49-81eb-9f62cdcf1355', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0de284-b54e-45af-8b77-532074a6523f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0de284-b54e-45af-8b77-532074a6523f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f95d76-e429-4fe8-ba57-0ec498df1d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:17 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Volume 65db3972-07cc-4c49-81eb-9f62cdcf1355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65db3972-07cc-4c49-81eb-9f62cdcf1355', 'volume_size': 1} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65db3972-07cc-4c49-81eb-9f62cdcf1355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df5c3fdb8944d1fa05d4b2449ffd3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:37:17Z,use_quota=True,user_id='f2f218db193c41a0981315ad45e40021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Creating volume 65db3972-07cc-4c49-81eb-9f62cdcf1355 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:37:17 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-65db3972-07cc-4c49-81eb-9f62cdcf1355 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:17 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-65db3972-07cc-4c49-81eb-9f62cdcf1355 1073741824 Jul 23 22:37:17 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:17 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-65db3972-07cc-4c49-81eb-9f62cdcf1355 1073741824" returned: 0 in 0.414s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-65db3972-07cc-4c49-81eb-9f62cdcf1355 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:17 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-65db3972-07cc-4c49-81eb-9f62cdcf1355 Jul 23 22:37:17 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:18 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-65db3972-07cc-4c49-81eb-9f62cdcf1355" returned: 0 in 0.238s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f95d76-e429-4fe8-ba57-0ec498df1d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65db3972-07cc-4c49-81eb-9f62cdcf1355', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8b7bcb-ef67-4379-b418-0e394a35162a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:18 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Volume volume-65db3972-07cc-4c49-81eb-9f62cdcf1355 (65db3972-07cc-4c49-81eb-9f62cdcf1355): created successfully Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8b7bcb-ef67-4379-b418-0e394a35162a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Flow 'volume_create_manager' (3869b78d-6b12-4f35-94a5-881f32bff851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:37:18 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-d1c5e5e2-9074-4667-934d-3eb3cddcb514 tempest-CinderUnicodeTest-2080991980 None] Created volume successfully. Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Flow 'volume_create_manager' (10184a68-22ea-403b-b029-14369ea6ab6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e01669d-6bef-4ce9-ac33-f6680a603a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e01669d-6bef-4ce9-ac33-f6680a603a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:37:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1253311534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1a9c15-cc86-41fb-b682-a83c37165fd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df5c3fdb8944d1fa05d4b2449ffd3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:37:19Z,use_quota=True,user_id='f2f218db193c41a0981315ad45e40021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a02e35-ac22-46e8-ba66-6406fa8355d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a02e35-ac22-46e8-ba66-6406fa8355d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86588be4-84e9-4866-8d0a-a19e15919364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86588be4-84e9-4866-8d0a-a19e15919364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b1a9c15-cc86-41fb-b682-a83c37165fd3', 'volume_name': 'volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a82e683-3d5c-4383-9169-df141990b06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a82e683-3d5c-4383-9169-df141990b06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e70ffc-17ca-47f4-9cf4-17ee3c22a0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:18 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Volume 3b1a9c15-cc86-41fb-b682-a83c37165fd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3', 'volume_size': 1} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:37:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1253311534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1a9c15-cc86-41fb-b682-a83c37165fd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6df5c3fdb8944d1fa05d4b2449ffd3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:37:19Z,use_quota=True,user_id='f2f218db193c41a0981315ad45e40021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Creating volume 3b1a9c15-cc86-41fb-b682-a83c37165fd3 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:37:18 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:37:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:18 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 1073741824 Jul 23 22:37:18 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:19 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 1073741824" returned: 0 in 0.411s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:19 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 Jul 23 22:37:19 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:19 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3" returned: 0 in 0.238s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:37:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0e70ffc-17ca-47f4-9cf4-17ee3c22a0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23af9ad-4b15-458d-8922-b6e18b166bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:19 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Volume volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 (3b1a9c15-cc86-41fb-b682-a83c37165fd3): created successfully Jul 23 22:37:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23af9ad-4b15-458d-8922-b6e18b166bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Flow 'volume_create_manager' (10184a68-22ea-403b-b029-14369ea6ab6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:37:19 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-82ec2487-6887-4a75-8f5a-73032f51dd04 tempest-CinderUnicodeTest-2080991980 None] Created volume successfully. Jul 23 22:37:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] Creating offline snapshot 7b8b4c9a-a716-414e-853c-2ea2cba1fe92 of volume 3b1a9c15-cc86-41fb-b682-a83c37165fd3 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:37:20 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0358728f-b608-4c52-a518-01a90ce2ee0e]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:37:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:20 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 Jul 23 22:37:20 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:20 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3" returned: 0 in 0.351s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:20 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92 1G Jul 23 22:37:20 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:20 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92 1G" returned: 0 in 0.398s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:20 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92 Jul 23 22:37:20 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:21 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92" returned: 0 in 0.288s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:21 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92 is being set with open permissions: ugo+rw Jul 23 22:37:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:21 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92 Jul 23 22:37:21 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:21 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92" returned: 0 in 0.248s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:21 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.info Jul 23 22:37:21 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:21 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.info" returned: 0 in 0.250s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:21 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.info is being set with open permissions: ugo+rw Jul 23 22:37:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:21 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.info Jul 23 22:37:21 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:21 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.info" returned: 0 in 0.237s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:21 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-553b40bb-0b14-485c-9fde-17565822e170 tempest-CinderUnicodeTest-2080991980 None] Create snapshot completed successfully Jul 23 22:37:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Acquiring lock "cinder-7b8b4c9a-a716-414e-853c-2ea2cba1fe92-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:37:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Lock "cinder-7b8b4c9a-a716-414e-853c-2ea2cba1fe92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:37:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Acquiring lock "cinder-quobyte-3b1a9c15-cc86-41fb-b682-a83c37165fd3" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:37:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Lock "cinder-quobyte-3b1a9c15-cc86-41fb-b682-a83c37165fd3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:37:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Acquiring lock "cinder-quobyte-7b8b4c9a-a716-414e-853c-2ea2cba1fe92" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:37:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Lock "cinder-quobyte-7b8b4c9a-a716-414e-853c-2ea2cba1fe92" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:37:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Deleting offline snapshot 7b8b4c9a-a716-414e-853c-2ea2cba1fe92 of volume 3b1a9c15-cc86-41fb-b682-a83c37165fd3 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:37:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] snapshot_file for this snap is: volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:37:22 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0361b7b2-5f35-4367-881c-8f9998912ec8]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:37:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:22 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92 Jul 23 22:37:22 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:22 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92" returned: 0 in 0.358s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:37:22 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[50490526-5731-4ecd-86a7-c2c5bcac52a1]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:37:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:22 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 Jul 23 22:37:22 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:22 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3" returned: 0 in 0.342s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:22 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92 Jul 23 22:37:22 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:23 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92" returned: 0 in 0.330s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:23 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92 Jul 23 22:37:23 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:23 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3.7b8b4c9a-a716-414e-853c-2ea2cba1fe92" returned: 0 in 0.248s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Lock "cinder-quobyte-7b8b4c9a-a716-414e-853c-2ea2cba1fe92" released by "_delete_snapshot" :: held 1.375s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:37:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Lock "cinder-quobyte-3b1a9c15-cc86-41fb-b682-a83c37165fd3" released by "delete_snapshot" :: held 1.396s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:37:23 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Created reservations ['6e114ef3-5983-4408-a0af-f7435f6406a7', '32db159d-7d39-4b5f-a0a1-39b9e96b7feb', '89850160-d846-41be-98a0-1347f1752d35', '967d35e2-47a9-4d85-8d50-575204455d9e'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:37:23 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Delete snapshot completed successfully. Jul 23 22:37:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6504fbd2-f482-4b30-a5e2-47891efd12cb tempest-CinderUnicodeTest-2080991980 None] Lock "cinder-7b8b4c9a-a716-414e-853c-2ea2cba1fe92-delete_snapshot" released by "delete_snapshot" :: held 1.525s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:37:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Acquiring lock "cinder-3b1a9c15-cc86-41fb-b682-a83c37165fd3-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:37:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Lock "cinder-3b1a9c15-cc86-41fb-b682-a83c37165fd3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:37:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Acquiring lock "cinder-quobyte-3b1a9c15-cc86-41fb-b682-a83c37165fd3" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:37:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Lock "cinder-quobyte-3b1a9c15-cc86-41fb-b682-a83c37165fd3" acquired by "delete_volume" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:37:24 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4bf54b-ac5f-4a9e-9808-4a0ae0ee28c7]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:37:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:24 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 Jul 23 22:37:24 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:24 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3" returned: 0 in 0.349s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:24 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3 Jul 23 22:37:24 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:25 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-3b1a9c15-cc86-41fb-b682-a83c37165fd3" returned: 0 in 0.254s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Lock "cinder-quobyte-3b1a9c15-cc86-41fb-b682-a83c37165fd3" released by "delete_volume" :: held 0.661s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Created reservations ['fc2ff665-e415-4caf-8795-c8d6789e758f', '3ced707d-61fd-47ab-9b02-c61e1eaa1e8f', 'fffa1ba6-719a-426b-9af3-e300f408332d', '83c15bba-a88c-438c-b636-1e5f149c45ea'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:25 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:37:25 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:25 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.246s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:37:25 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Deleted volume successfully. Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4e0a7e89-7cef-4c91-b8e2-89574c54f0f9 tempest-CinderUnicodeTest-2080991980 None] Lock "cinder-3b1a9c15-cc86-41fb-b682-a83c37165fd3-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Acquiring lock "cinder-65db3972-07cc-4c49-81eb-9f62cdcf1355-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Lock "cinder-65db3972-07cc-4c49-81eb-9f62cdcf1355-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Acquiring lock "cinder-quobyte-65db3972-07cc-4c49-81eb-9f62cdcf1355" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Lock "cinder-quobyte-65db3972-07cc-4c49-81eb-9f62cdcf1355" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[617525a7-b472-477a-aa45-8d557b3e3dad]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-65db3972-07cc-4c49-81eb-9f62cdcf1355 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:25 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-65db3972-07cc-4c49-81eb-9f62cdcf1355 Jul 23 22:37:25 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:25 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-65db3972-07cc-4c49-81eb-9f62cdcf1355" returned: 0 in 0.348s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-65db3972-07cc-4c49-81eb-9f62cdcf1355 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:25 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-65db3972-07cc-4c49-81eb-9f62cdcf1355 Jul 23 22:37:25 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:26 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:37:26 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:26 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-65db3972-07cc-4c49-81eb-9f62cdcf1355" returned: 0 in 0.238s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Lock "cinder-quobyte-65db3972-07cc-4c49-81eb-9f62cdcf1355" released by "delete_volume" :: held 0.631s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Created reservations ['14432858-f17e-4b23-9c68-61e35573d79c', '7369e224-6648-4a93-97d8-1ed73d6a944f', '41a39d83-14d2-4d74-9b82-d988f1d8dd24', '71ce5315-45f9-4b70-b327-2789c9b3b392'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:26 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:37:26 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:26 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.257s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 29 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:37:26 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.243s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:37:26 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Deleted volume successfully. Jul 23 22:37:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-13b437d8-0ae9-4c8e-8702-709ee4318cc4 tempest-CinderUnicodeTest-2080991980 None] Lock "cinder-65db3972-07cc-4c49-81eb-9f62cdcf1355-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Flow 'volume_create_manager' (9442f6cd-70e3-430c-b688-7571f63ac63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c6fcb8-ffef-4969-a4d3-4582832060a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c6fcb8-ffef-4969-a4d3-4582832060a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504426315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9d5d97-15c6-4887-b92b-14e351b32d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45460965606f438eb637663309043511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:37:30Z,use_quota=True,user_id='e531424bafe94a428b8fed85dcd53344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894a4c01-4ee6-4b3e-bf35-4b07f02946e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894a4c01-4ee6-4b3e-bf35-4b07f02946e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5674f815-0fca-480b-8bc8-f600a5f7e6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5674f815-0fca-480b-8bc8-f600a5f7e6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9d5d97-15c6-4887-b92b-14e351b32d44', 'volume_name': 'volume-7f9d5d97-15c6-4887-b92b-14e351b32d44', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409f00d1-5fc3-4e3a-8a4a-e24bde4280d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409f00d1-5fc3-4e3a-8a4a-e24bde4280d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529e8d25-fc34-4137-8791-221c363a3667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:29 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Volume 7f9d5d97-15c6-4887-b92b-14e351b32d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9d5d97-15c6-4887-b92b-14e351b32d44', 'volume_size': 1} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504426315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9d5d97-15c6-4887-b92b-14e351b32d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45460965606f438eb637663309043511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:37:30Z,use_quota=True,user_id='e531424bafe94a428b8fed85dcd53344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Creating volume 7f9d5d97-15c6-4887-b92b-14e351b32d44 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:37:29 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:37:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7f9d5d97-15c6-4887-b92b-14e351b32d44 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:29 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7f9d5d97-15c6-4887-b92b-14e351b32d44 1073741824 Jul 23 22:37:29 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:30 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7f9d5d97-15c6-4887-b92b-14e351b32d44 1073741824" returned: 0 in 0.431s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7f9d5d97-15c6-4887-b92b-14e351b32d44 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:30 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7f9d5d97-15c6-4887-b92b-14e351b32d44 Jul 23 22:37:30 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:30 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7f9d5d97-15c6-4887-b92b-14e351b32d44" returned: 0 in 0.248s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:30 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:37:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529e8d25-fc34-4137-8791-221c363a3667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9d5d97-15c6-4887-b92b-14e351b32d44', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046e4559-9f79-4b71-827e-c5589c10487d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:30 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Volume volume-7f9d5d97-15c6-4887-b92b-14e351b32d44 (7f9d5d97-15c6-4887-b92b-14e351b32d44): created successfully Jul 23 22:37:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046e4559-9f79-4b71-827e-c5589c10487d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:30 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Flow 'volume_create_manager' (9442f6cd-70e3-430c-b688-7571f63ac63d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:37:30 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-7f3b2741-c117-42b0-8095-d83e804e63c0 tempest-ProjectReaderTests-252009072 None] Created volume successfully. Jul 23 22:37:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Acquiring lock "cinder-7f9d5d97-15c6-4887-b92b-14e351b32d44-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:37:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Lock "cinder-7f9d5d97-15c6-4887-b92b-14e351b32d44-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:37:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Acquiring lock "cinder-quobyte-7f9d5d97-15c6-4887-b92b-14e351b32d44" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:37:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Lock "cinder-quobyte-7f9d5d97-15c6-4887-b92b-14e351b32d44" acquired by "delete_volume" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:37:31 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4733ec0-da10-4f26-8129-b72c2671797a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:37:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7f9d5d97-15c6-4887-b92b-14e351b32d44 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:31 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7f9d5d97-15c6-4887-b92b-14e351b32d44 Jul 23 22:37:31 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:31 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7f9d5d97-15c6-4887-b92b-14e351b32d44" returned: 0 in 0.351s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7f9d5d97-15c6-4887-b92b-14e351b32d44 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:31 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7f9d5d97-15c6-4887-b92b-14e351b32d44 Jul 23 22:37:31 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:31 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7f9d5d97-15c6-4887-b92b-14e351b32d44" returned: 0 in 0.251s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Lock "cinder-quobyte-7f9d5d97-15c6-4887-b92b-14e351b32d44" released by "delete_volume" :: held 0.640s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:37:31 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Created reservations ['ce8e2071-338d-45b0-9a55-4031dfce44fa', '58ac897a-337a-4f9e-ab5f-37a3953a97ea', 'f72fe3f8-a87e-43ae-bc6b-8264a3182abe', 'c4ba9abc-51eb-4093-b4b0-882f4a9eee16'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:37:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:37:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:37:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:31 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:37:31 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:32 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.245s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:37:32 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Deleted volume successfully. Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9e74a73d-18b8-41a5-bd18-bbcff06f0f09 tempest-ProjectReaderTests-252009072 None] Lock "cinder-7f9d5d97-15c6-4887-b92b-14e351b32d44-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Flow 'volume_create_manager' (e37b8167-32a4-4fee-a2f4-de3beed15a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebf70b6-bb1d-4a6b-862f-5a8fb8ab200f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebf70b6-bb1d-4a6b-862f-5a8fb8ab200f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-769894951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dadd7dd-88df-44a8-ab97-3f65be97b4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45460965606f438eb637663309043511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:37:32Z,use_quota=True,user_id='e531424bafe94a428b8fed85dcd53344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c16244-062c-4467-8f74-52cf29aafcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c16244-062c-4467-8f74-52cf29aafcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca1c6d7-f772-434e-a065-11ca49151962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca1c6d7-f772-434e-a065-11ca49151962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dadd7dd-88df-44a8-ab97-3f65be97b4a4', 'volume_name': 'volume-9dadd7dd-88df-44a8-ab97-3f65be97b4a4', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93fea61c-5988-4193-a74f-259f5509cae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93fea61c-5988-4193-a74f-259f5509cae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc61bc6-4e44-46bd-8840-88592e4d7877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:32 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Volume 9dadd7dd-88df-44a8-ab97-3f65be97b4a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dadd7dd-88df-44a8-ab97-3f65be97b4a4', 'volume_size': 1} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-769894951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dadd7dd-88df-44a8-ab97-3f65be97b4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45460965606f438eb637663309043511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:37:32Z,use_quota=True,user_id='e531424bafe94a428b8fed85dcd53344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Creating volume 9dadd7dd-88df-44a8-ab97-3f65be97b4a4 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:37:32 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:37:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9dadd7dd-88df-44a8-ab97-3f65be97b4a4 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:32 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9dadd7dd-88df-44a8-ab97-3f65be97b4a4 1073741824 Jul 23 22:37:32 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:33 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9dadd7dd-88df-44a8-ab97-3f65be97b4a4 1073741824" returned: 0 in 0.408s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9dadd7dd-88df-44a8-ab97-3f65be97b4a4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:33 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9dadd7dd-88df-44a8-ab97-3f65be97b4a4 Jul 23 22:37:33 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:33 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9dadd7dd-88df-44a8-ab97-3f65be97b4a4" returned: 0 in 0.247s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc61bc6-4e44-46bd-8840-88592e4d7877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dadd7dd-88df-44a8-ab97-3f65be97b4a4', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f5950a-60fe-4cd5-9354-29d49478e4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:33 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Volume volume-9dadd7dd-88df-44a8-ab97-3f65be97b4a4 (9dadd7dd-88df-44a8-ab97-3f65be97b4a4): created successfully Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f5950a-60fe-4cd5-9354-29d49478e4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Flow 'volume_create_manager' (e37b8167-32a4-4fee-a2f4-de3beed15a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:37:33 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-8d96e9bc-433d-4d64-963e-c446d642fa84 tempest-ProjectReaderTests-252009072 None] Created volume successfully. Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Acquiring lock "cinder-9dadd7dd-88df-44a8-ab97-3f65be97b4a4-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Lock "cinder-9dadd7dd-88df-44a8-ab97-3f65be97b4a4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Acquiring lock "cinder-quobyte-9dadd7dd-88df-44a8-ab97-3f65be97b4a4" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Lock "cinder-quobyte-9dadd7dd-88df-44a8-ab97-3f65be97b4a4" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f3c881-3368-49fc-919e-9cf1b0dfcce4]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9dadd7dd-88df-44a8-ab97-3f65be97b4a4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:33 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9dadd7dd-88df-44a8-ab97-3f65be97b4a4 Jul 23 22:37:33 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:33 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9dadd7dd-88df-44a8-ab97-3f65be97b4a4" returned: 0 in 0.349s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9dadd7dd-88df-44a8-ab97-3f65be97b4a4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:34 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9dadd7dd-88df-44a8-ab97-3f65be97b4a4 Jul 23 22:37:34 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:34 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9dadd7dd-88df-44a8-ab97-3f65be97b4a4" returned: 0 in 0.235s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:34 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Lock "cinder-quobyte-9dadd7dd-88df-44a8-ab97-3f65be97b4a4" released by "delete_volume" :: held 0.621s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:37:34 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Created reservations ['223360d5-18f9-4ceb-955d-6d06a55583e6', '48848ece-280a-4e46-b676-21a187205445', '216390f5-9554-4535-adf2-dd8a0395c3ec', 'bec257bf-ac08-441c-a39e-d3981e94107f'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:37:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:37:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:37:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:34 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:37:34 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:37:34 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 23 22:37:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.241s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:37:34 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:37:34 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Deleted volume successfully. Jul 23 22:37:34 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ef148fa3-072a-40fe-94f7-29227df37a8b tempest-ProjectReaderTests-252009072 None] Lock "cinder-9dadd7dd-88df-44a8-ab97-3f65be97b4a4-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:37:44 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=70,cinder:UPDATE=94,cinder:DELETE=9,cinder:INSERT=28 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:37:44 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=77,cinder:UPDATE=90,cinder:INSERT=25,cinder:DELETE=7 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Flow 'volume_create_manager' (a7f9776f-3f86-4327-bfde-e6e98e52b829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb7cf9a-ef4d-4c48-afea-eb6cb4f63dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb7cf9a-ef4d-4c48-afea-eb6cb4f63dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-957695983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fde85f-087a-465f-bb8b-3f7648b7c994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23df5acaa7bf4d3cb8177200fc0562bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:00Z,use_quota=True,user_id='aaed766d57f543f4aced5dfdf4fc020a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d34e1dd-ac35-4c9f-9046-3b38d46ef890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d34e1dd-ac35-4c9f-9046-3b38d46ef890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94ad7e5-4b42-4c99-b4d2-6e14b0267dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94ad7e5-4b42-4c99-b4d2-6e14b0267dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2fde85f-087a-465f-bb8b-3f7648b7c994', 'volume_name': 'volume-a2fde85f-087a-465f-bb8b-3f7648b7c994', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be86d88-8e8d-41a3-94bf-e6db14c35e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be86d88-8e8d-41a3-94bf-e6db14c35e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cbf388-58e7-4df6-8655-1aa1e748454f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:37:59 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Volume a2fde85f-087a-465f-bb8b-3f7648b7c994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2fde85f-087a-465f-bb8b-3f7648b7c994', 'volume_size': 1} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-957695983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fde85f-087a-465f-bb8b-3f7648b7c994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23df5acaa7bf4d3cb8177200fc0562bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:00Z,use_quota=True,user_id='aaed766d57f543f4aced5dfdf4fc020a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Creating volume a2fde85f-087a-465f-bb8b-3f7648b7c994 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:37:59 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:37:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:37:59 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 1073741824 Jul 23 22:37:59 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:00 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 1073741824" returned: 0 in 0.404s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:00 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 Jul 23 22:38:00 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:00 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994" returned: 0 in 0.240s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cbf388-58e7-4df6-8655-1aa1e748454f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2fde85f-087a-465f-bb8b-3f7648b7c994', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b24ef1a-08f3-4039-abda-c155ef223035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:00 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Volume volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 (a2fde85f-087a-465f-bb8b-3f7648b7c994): created successfully Jul 23 22:38:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b24ef1a-08f3-4039-abda-c155ef223035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:00 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Flow 'volume_create_manager' (a7f9776f-3f86-4327-bfde-e6e98e52b829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:00 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-10793d84-0c1c-4066-8a3b-5433aee271de tempest-SnapshotDependencyTests-1444599374 None] Created volume successfully. Jul 23 22:38:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] Creating offline snapshot 2a6d163b-556b-418e-883e-7b8943ecab13 of volume a2fde85f-087a-465f-bb8b-3f7648b7c994 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:38:00 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fa0fcb-39df-4ba7-9747-c50e49c54fa2]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:01 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 Jul 23 22:38:01 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:01 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994" returned: 0 in 0.352s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:01 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 1G Jul 23 22:38:01 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:01 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 1G" returned: 0 in 0.383s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:01 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 Jul 23 22:38:01 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:01 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13" returned: 0 in 0.288s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:01 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 is being set with open permissions: ugo+rw Jul 23 22:38:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:02 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 Jul 23 22:38:02 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:02 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13" returned: 0 in 0.241s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:02 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.info Jul 23 22:38:02 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:02 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.info" returned: 0 in 0.246s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:02 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.info is being set with open permissions: ugo+rw Jul 23 22:38:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:02 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.info Jul 23 22:38:02 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:02 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.info" returned: 0 in 0.243s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:02 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e9d4311b-aaeb-4354-88f5-c43279e5435a tempest-SnapshotDependencyTests-1444599374 None] Create snapshot completed successfully Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Flow 'volume_create_manager' (0f71a06d-206e-4751-a662-43d974cd5741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a348ed0-b653-4a87-bccf-9313d4714443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a348ed0-b653-4a87-bccf-9313d4714443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7c8cc3-c892-4413-8aad-7fabce66fb6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23df5acaa7bf4d3cb8177200fc0562bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2a6d163b-556b-418e-883e-7b8943ecab13,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:04Z,use_quota=True,user_id='aaed766d57f543f4aced5dfdf4fc020a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33dca08f-851c-4a7d-95b1-1f46627fdb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33dca08f-851c-4a7d-95b1-1f46627fdb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64cf8384-2639-4215-900e-033675b13294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64cf8384-2639-4215-900e-033675b13294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f7c8cc3-c892-4413-8aad-7fabce66fb6c', 'volume_name': 'volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c', 'volume_size': 1, 'snapshot_id': '2a6d163b-556b-418e-883e-7b8943ecab13'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca73156e-4966-434b-a4f7-e69117b303a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca73156e-4966-434b-a4f7-e69117b303a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d99a115-ba1e-40e1-8d83-006984e8417a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:03 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Volume 6f7c8cc3-c892-4413-8aad-7fabce66fb6c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c', 'volume_size': 1, 'snapshot_id': '2a6d163b-556b-418e-883e-7b8943ecab13'} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "cinder-quobyte-2a6d163b-556b-418e-883e-7b8943ecab13-6f7c8cc3-c892-4413-8aad-7fabce66fb6c" by "_create_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-quobyte-2a6d163b-556b-418e-883e-7b8943ecab13-6f7c8cc3-c892-4413-8aad-7fabce66fb6c" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Creating volume 6f7c8cc3-c892-4413-8aad-7fabce66fb6c from snapshot 2a6d163b-556b-418e-883e-7b8943ecab13 {{(pid=88308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "cinder-quobyte-6f7c8cc3-c892-4413-8aad-7fabce66fb6c" by "_copy_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-quobyte-6f7c8cc3-c892-4413-8aad-7fabce66fb6c" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] snapshot: 2a6d163b-556b-418e-883e-7b8943ecab13, volume: 6f7c8cc3-c892-4413-8aad-7fabce66fb6c, {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6f5991-9f77-402e-9eb3-e2d9dd006cb2]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:03 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 Jul 23 22:38:03 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:04 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13" returned: 0 in 0.342s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:04 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2fde85f-087a-465f-bb8b-3f7648b7c994(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:38:04 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 23 22:38:04 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Creating direct copy from snapshot {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 23 22:38:04 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[decb79f9-5c1d-4ff4-891b-003ff8d50344]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:04 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 Jul 23 22:38:04 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:04 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994" returned: 0 in 0.350s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:04 devstack cinder-volume[88308]: DEBUG cinder.utils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Path /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c not found in is_blk_device check {{(pid=88308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 22:38:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:04 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c Jul 23 22:38:04 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:08 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c" returned: 0 in 3.989s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:08 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cd621b-df74-4a2c-a616-2bd0c8ac69ae]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:08 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 Jul 23 22:38:08 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:08 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994" returned: 0 in 0.536s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:08 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994, size 1024.00 MB, duration 3.99 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:38:08 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Converted 1024.00 MB image at 256.63 MB/s Jul 23 22:38:08 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c is being set with open permissions: ugo+rw Jul 23 22:38:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:09 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c Jul 23 22:38:09 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:09 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c" returned: 0 in 0.238s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-quobyte-6f7c8cc3-c892-4413-8aad-7fabce66fb6c" released by "_copy_volume_from_snapshot" :: held 5.542s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-quobyte-2a6d163b-556b-418e-883e-7b8943ecab13-6f7c8cc3-c892-4413-8aad-7fabce66fb6c" released by "_create_volume_from_snapshot" :: held 5.570s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.583s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d99a115-ba1e-40e1-8d83-006984e8417a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c', 'volume_size': 1, 'snapshot_id': '2a6d163b-556b-418e-883e-7b8943ecab13'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6158f3d0-ade3-4eca-9c6e-a885e42cc7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:09 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Volume volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c (6f7c8cc3-c892-4413-8aad-7fabce66fb6c): created successfully Jul 23 22:38:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6158f3d0-ade3-4eca-9c6e-a885e42cc7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Flow 'volume_create_manager' (0f71a06d-206e-4751-a662-43d974cd5741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:09 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ad9f7cdb-a3bf-4d8f-bd63-027984f30c99 tempest-SnapshotDependencyTests-1444599374 None] Created volume successfully. Jul 23 22:38:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "cinder-2a6d163b-556b-418e-883e-7b8943ecab13-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-2a6d163b-556b-418e-883e-7b8943ecab13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "cinder-quobyte-a2fde85f-087a-465f-bb8b-3f7648b7c994" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-quobyte-a2fde85f-087a-465f-bb8b-3f7648b7c994" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "cinder-quobyte-2a6d163b-556b-418e-883e-7b8943ecab13" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-quobyte-2a6d163b-556b-418e-883e-7b8943ecab13" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Deleting offline snapshot 2a6d163b-556b-418e-883e-7b8943ecab13 of volume a2fde85f-087a-465f-bb8b-3f7648b7c994 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:38:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] snapshot_file for this snap is: volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:38:10 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bb7e44-fda5-403a-a555-e51c68de8546]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:10 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 Jul 23 22:38:10 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:10 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13" returned: 0 in 0.348s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2fde85f-087a-465f-bb8b-3f7648b7c994(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:38:10 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ccd73f-57eb-4cfb-adb5-13b53cd4b234]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:10 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 Jul 23 22:38:10 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:10 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994" returned: 0 in 0.353s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:10 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 Jul 23 22:38:10 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:11 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13" returned: 0 in 0.327s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:11 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13 Jul 23 22:38:11 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:11 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994.2a6d163b-556b-418e-883e-7b8943ecab13" returned: 0 in 0.249s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-quobyte-2a6d163b-556b-418e-883e-7b8943ecab13" released by "_delete_snapshot" :: held 1.369s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-quobyte-a2fde85f-087a-465f-bb8b-3f7648b7c994" released by "delete_snapshot" :: held 1.388s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:11 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Created reservations ['1d5f091a-1166-45c9-8f81-6e35b9376984', '0891f044-6480-46c6-be67-0271ee9bb730', '0eb5ac09-9813-4155-b687-0439fc35cffc', 'b418f08a-498d-4fb1-9572-98fc4a4c2b6e'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:38:11 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Delete snapshot completed successfully. Jul 23 22:38:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5ea9cc77-da57-42e3-9520-e91aad3f2b1c tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-2a6d163b-556b-418e-883e-7b8943ecab13-delete_snapshot" released by "delete_snapshot" :: held 1.507s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "cinder-a2fde85f-087a-465f-bb8b-3f7648b7c994-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-a2fde85f-087a-465f-bb8b-3f7648b7c994-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "cinder-quobyte-a2fde85f-087a-465f-bb8b-3f7648b7c994" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-quobyte-a2fde85f-087a-465f-bb8b-3f7648b7c994" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:12 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e88270-af0d-4994-a965-ccf096032d0f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:12 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 Jul 23 22:38:12 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:12 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994" returned: 0 in 0.346s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:12 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994 Jul 23 22:38:12 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:12 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a2fde85f-087a-465f-bb8b-3f7648b7c994" returned: 0 in 0.243s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-quobyte-a2fde85f-087a-465f-bb8b-3f7648b7c994" released by "delete_volume" :: held 0.644s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:12 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Created reservations ['f4de525e-d16b-4133-bf3d-12ba9e5685c1', '04946692-3d28-40e7-a082-fd9447f2c05f', 'b40c4bb3-408e-4a41-80fe-238d95ef2c6c', '10528eb2-7561-49aa-bd81-d96f6ce12450'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:13 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:38:13 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:13 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.234s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:38:13 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Deleted volume successfully. Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-55cf9783-79ab-4b5a-abaa-63490e624371 tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-a2fde85f-087a-465f-bb8b-3f7648b7c994-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "cinder-6f7c8cc3-c892-4413-8aad-7fabce66fb6c-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-6f7c8cc3-c892-4413-8aad-7fabce66fb6c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "cinder-quobyte-6f7c8cc3-c892-4413-8aad-7fabce66fb6c" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-quobyte-6f7c8cc3-c892-4413-8aad-7fabce66fb6c" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65248fa-facf-4c25-a111-509ad101643a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:13 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c Jul 23 22:38:13 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:13 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c" returned: 0 in 0.354s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:13 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c Jul 23 22:38:13 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:14 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-6f7c8cc3-c892-4413-8aad-7fabce66fb6c" returned: 0 in 0.244s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-quobyte-6f7c8cc3-c892-4413-8aad-7fabce66fb6c" released by "delete_volume" :: held 0.637s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:14 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Created reservations ['f7b4df2a-8f0e-4fcf-9459-f6d2715c68bf', '9469842b-8eea-498a-8b12-1d71abe4ba3f', 'f34aedb0-ceb0-4e4e-ade6-78ed728abd9b', 'df17cd62-3039-43e0-a3ea-d48bf4fa8e03'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:38:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:14 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:14 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:14 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:38:14 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:14 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.242s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:14 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:38:14 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Deleted volume successfully. Jul 23 22:38:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-9d9b8654-2153-415b-b391-c219afc09675 tempest-SnapshotDependencyTests-1444599374 None] Lock "cinder-6f7c8cc3-c892-4413-8aad-7fabce66fb6c-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:24 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:UPDATE=28,cinder:DELETE=3,cinder:SELECT=21,cinder:INSERT=7 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:38:24 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=26,cinder:INSERT=7,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:38:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:38:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:26 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:38:26 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:26 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.260s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:38:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:38:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 29 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:38:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Flow 'volume_create_manager' (84c55d57-ab87-4202-b6d4-16c75cff6e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e9a594-7d0f-45f2-b256-623231bf1825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e9a594-7d0f-45f2-b256-623231bf1825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1125518257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda4a88d-fd76-47a4-a320-7219f48fe0fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a22238eab843b0b331478da02ea2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:33Z,use_quota=True,user_id='ccc27ca538964dd5a99e29d8671124d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec62c39-d3e7-4a34-b2e6-3d388ccaaa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec62c39-d3e7-4a34-b2e6-3d388ccaaa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0311c5be-6c1f-462b-808b-64c7be8d96ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0311c5be-6c1f-462b-808b-64c7be8d96ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dda4a88d-fd76-47a4-a320-7219f48fe0fb', 'volume_name': 'volume-dda4a88d-fd76-47a4-a320-7219f48fe0fb', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ce8e15-68aa-4d40-87db-b5d103c1fdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ce8e15-68aa-4d40-87db-b5d103c1fdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dff364a0-213c-4fa0-bcb5-0cd9eec608a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:32 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Volume dda4a88d-fd76-47a4-a320-7219f48fe0fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dda4a88d-fd76-47a4-a320-7219f48fe0fb', 'volume_size': 1} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1125518257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda4a88d-fd76-47a4-a320-7219f48fe0fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a22238eab843b0b331478da02ea2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:33Z,use_quota=True,user_id='ccc27ca538964dd5a99e29d8671124d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Creating volume dda4a88d-fd76-47a4-a320-7219f48fe0fb {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:32 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:38:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dda4a88d-fd76-47a4-a320-7219f48fe0fb 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:32 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dda4a88d-fd76-47a4-a320-7219f48fe0fb 1073741824 Jul 23 22:38:32 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Flow 'volume_create_manager' (d66ea518-1260-4a37-a2d2-83396ac93eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7284818-2b23-4e99-9b82-c58124ef8263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7284818-2b23-4e99-9b82-c58124ef8263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1208711741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e0f3ef-71d9-4273-aba5-d75dfa538c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a22238eab843b0b331478da02ea2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:33Z,use_quota=True,user_id='ccc27ca538964dd5a99e29d8671124d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481aa02f-0d31-4268-a6a1-eb1764444054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481aa02f-0d31-4268-a6a1-eb1764444054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ba90fbf-bb1c-47e8-95f7-1152074caf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ba90fbf-bb1c-47e8-95f7-1152074caf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4e0f3ef-71d9-4273-aba5-d75dfa538c28', 'volume_name': 'volume-b4e0f3ef-71d9-4273-aba5-d75dfa538c28', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0a01a1-6888-4344-9c14-ff05d6042e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0a01a1-6888-4344-9c14-ff05d6042e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbca595-6ad4-4c0d-8b6a-3cce734ad33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:33 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Volume b4e0f3ef-71d9-4273-aba5-d75dfa538c28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4e0f3ef-71d9-4273-aba5-d75dfa538c28', 'volume_size': 1} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:33 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dda4a88d-fd76-47a4-a320-7219f48fe0fb 1073741824" returned: 0 in 0.678s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dda4a88d-fd76-47a4-a320-7219f48fe0fb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:33 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dda4a88d-fd76-47a4-a320-7219f48fe0fb Jul 23 22:38:33 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Flow 'volume_create_manager' (608bfc8d-c5d0-4663-88b4-e297a1c4b6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (598a9803-808f-4441-b399-08b70d1cf913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (598a9803-808f-4441-b399-08b70d1cf913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-509900111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f98d4c-e083-41e1-a628-fad3a53b77a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5cedf23a7b404ca3c15905476fa116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:34Z,use_quota=True,user_id='d0d1c88a1f2945d2bba2b0b591b29030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7b3675c-1cf3-4743-8818-1ce03c8dd892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7b3675c-1cf3-4743-8818-1ce03c8dd892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd7f563-cdcd-44d9-8555-abeb33f6a56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd7f563-cdcd-44d9-8555-abeb33f6a56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3f98d4c-e083-41e1-a628-fad3a53b77a5', 'volume_name': 'volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02fc581-d04d-4ef8-bb2c-01fe79dee73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02fc581-d04d-4ef8-bb2c-01fe79dee73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de59da7-9227-4f0b-a391-dae66d67a718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:33 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume d3f98d4c-e083-41e1-a628-fad3a53b77a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5', 'volume_size': 1} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-80c81723-0fa9-4d08-b538-910e2e92e7ab tempest-ProjectAdminTests-260317242 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7198677062988, 'free_capacity_gb': 1775.7198677062988, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88308) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Flow 'volume_create_manager' (e36f4a00-063b-4a93-9b54-69f651974f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32f4237-a9ec-4ee5-95fa-9e334ec3fa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32f4237-a9ec-4ee5-95fa-9e334ec3fa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1370379457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d94f51b-661f-4083-aa2d-04f5b2f7043d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a22238eab843b0b331478da02ea2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:34Z,use_quota=True,user_id='ccc27ca538964dd5a99e29d8671124d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e21fc5-0d5e-493b-872b-e008ef75b81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e21fc5-0d5e-493b-872b-e008ef75b81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc69b42b-5463-44b4-bc1e-b1a1b34fb6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc69b42b-5463-44b4-bc1e-b1a1b34fb6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d94f51b-661f-4083-aa2d-04f5b2f7043d', 'volume_name': 'volume-8d94f51b-661f-4083-aa2d-04f5b2f7043d', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13925978-3ae1-4d2c-a2df-fa08de00f8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13925978-3ae1-4d2c-a2df-fa08de00f8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82658b8d-7b2f-4416-82ea-5f8728aadf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:33 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Volume 8d94f51b-661f-4083-aa2d-04f5b2f7043d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d94f51b-661f-4083-aa2d-04f5b2f7043d', 'volume_size': 1} Jul 23 22:38:33 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:34 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dda4a88d-fd76-47a4-a320-7219f48fe0fb" returned: 0 in 0.424s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.700s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1208711741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e0f3ef-71d9-4273-aba5-d75dfa538c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a22238eab843b0b331478da02ea2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:33Z,use_quota=True,user_id='ccc27ca538964dd5a99e29d8671124d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Creating volume b4e0f3ef-71d9-4273-aba5-d75dfa538c28 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:34 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b4e0f3ef-71d9-4273-aba5-d75dfa538c28 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:34 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b4e0f3ef-71d9-4273-aba5-d75dfa538c28 1073741824 Jul 23 22:38:34 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dff364a0-213c-4fa0-bcb5-0cd9eec608a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dda4a88d-fd76-47a4-a320-7219f48fe0fb', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512bf2ec-8df0-4aee-a9ee-65636bfc2600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:34 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Volume volume-dda4a88d-fd76-47a4-a320-7219f48fe0fb (dda4a88d-fd76-47a4-a320-7219f48fe0fb): created successfully Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512bf2ec-8df0-4aee-a9ee-65636bfc2600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Flow 'volume_create_manager' (84c55d57-ab87-4202-b6d4-16c75cff6e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:34 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6160e94e-b6c3-426c-a70b-4b75e99d3186 tempest-CreateVolumesFromImageTest-516977014 None] Created volume successfully. Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Flow 'volume_create_manager' (3b20c33c-3672-488f-9886-7435a726a2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77ce4b3-2000-4185-9906-0847e81428ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77ce4b3-2000-4185-9906-0847e81428ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-667189120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f32d305-74ed-45a7-b528-a99c1ceff087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a22238eab843b0b331478da02ea2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:34Z,use_quota=True,user_id='ccc27ca538964dd5a99e29d8671124d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5fed277-8229-4b32-9fec-3106e74da6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5fed277-8229-4b32-9fec-3106e74da6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a67ca8-be90-4652-8148-049023d486cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a67ca8-be90-4652-8148-049023d486cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f32d305-74ed-45a7-b528-a99c1ceff087', 'volume_name': 'volume-2f32d305-74ed-45a7-b528-a99c1ceff087', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50d3585-dd3a-4f0b-9e2c-c98d4f4f7b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50d3585-dd3a-4f0b-9e2c-c98d4f4f7b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3bca1fe-f957-4fcd-b361-138afb79d0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:34 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Volume 2f32d305-74ed-45a7-b528-a99c1ceff087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f32d305-74ed-45a7-b528-a99c1ceff087', 'volume_size': 1} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:34 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b4e0f3ef-71d9-4273-aba5-d75dfa538c28 1073741824" returned: 0 in 0.654s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b4e0f3ef-71d9-4273-aba5-d75dfa538c28 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:34 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b4e0f3ef-71d9-4273-aba5-d75dfa538c28 Jul 23 22:38:34 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Flow 'volume_create_manager' (550a65e5-c1a6-4e82-b7b9-b77fdb71bb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6612a5f-3943-4094-8be4-a42d48df098d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6612a5f-3943-4094-8be4-a42d48df098d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-639703561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a22238eab843b0b331478da02ea2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:35Z,use_quota=True,user_id='ccc27ca538964dd5a99e29d8671124d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986e3bf1-6964-4b28-8dab-a814f2d43fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986e3bf1-6964-4b28-8dab-a814f2d43fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:35 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c6df17-f846-4011-8d3b-cfb795276c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c6df17-f846-4011-8d3b-cfb795276c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d', 'volume_name': 'volume-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1108b1c-da8d-401c-b895-3186337c5e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1108b1c-da8d-401c-b895-3186337c5e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3aac26-ca7c-49ca-aaec-348ec7b6b148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:35 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Volume 7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d', 'volume_size': 1} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b4e0f3ef-71d9-4273-aba5-d75dfa538c28" returned: 0 in 0.381s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.398s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-509900111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f98d4c-e083-41e1-a628-fad3a53b77a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5cedf23a7b404ca3c15905476fa116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:34Z,use_quota=True,user_id='d0d1c88a1f2945d2bba2b0b591b29030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Creating volume d3f98d4c-e083-41e1-a628-fad3a53b77a5 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:35 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbca595-6ad4-4c0d-8b6a-3cce734ad33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e0f3ef-71d9-4273-aba5-d75dfa538c28', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:35 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 1073741824 Jul 23 22:38:35 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a58c9b-f5ad-4df7-b1e4-148485c477e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:35 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Volume volume-b4e0f3ef-71d9-4273-aba5-d75dfa538c28 (b4e0f3ef-71d9-4273-aba5-d75dfa538c28): created successfully Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a58c9b-f5ad-4df7-b1e4-148485c477e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Flow 'volume_create_manager' (d66ea518-1260-4a37-a2d2-83396ac93eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:35 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b1c9b34f-256f-4d2e-93c4-557b8bb0a99e tempest-CreateVolumesFromImageTest-516977014 None] Created volume successfully. Jul 23 22:38:35 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 1073741824" returned: 0 in 0.559s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:35 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 Jul 23 22:38:35 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:36 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5" returned: 0 in 0.327s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.089s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1370379457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d94f51b-661f-4083-aa2d-04f5b2f7043d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a22238eab843b0b331478da02ea2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:34Z,use_quota=True,user_id='ccc27ca538964dd5a99e29d8671124d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Creating volume 8d94f51b-661f-4083-aa2d-04f5b2f7043d {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:36 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d94f51b-661f-4083-aa2d-04f5b2f7043d 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de59da7-9227-4f0b-a391-dae66d67a718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:36 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d94f51b-661f-4083-aa2d-04f5b2f7043d 1073741824 Jul 23 22:38:36 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a647433-f871-4d49-997c-a19ac5598c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:36 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 (d3f98d4c-e083-41e1-a628-fad3a53b77a5): created successfully Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a647433-f871-4d49-997c-a19ac5598c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Flow 'volume_create_manager' (608bfc8d-c5d0-4663-88b4-e297a1c4b6c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:36 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-aa236abf-89d1-4057-a746-fe0d177a31c2 tempest-CreateVolumesFromSnapshotTest-4572731 None] Created volume successfully. Jul 23 22:38:36 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d94f51b-661f-4083-aa2d-04f5b2f7043d 1073741824" returned: 0 in 0.525s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d94f51b-661f-4083-aa2d-04f5b2f7043d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:36 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d94f51b-661f-4083-aa2d-04f5b2f7043d Jul 23 22:38:36 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:36 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d94f51b-661f-4083-aa2d-04f5b2f7043d" returned: 0 in 0.327s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.420s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-667189120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f32d305-74ed-45a7-b528-a99c1ceff087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a22238eab843b0b331478da02ea2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:34Z,use_quota=True,user_id='ccc27ca538964dd5a99e29d8671124d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Creating volume 2f32d305-74ed-45a7-b528-a99c1ceff087 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:37 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2f32d305-74ed-45a7-b528-a99c1ceff087 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82658b8d-7b2f-4416-82ea-5f8728aadf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d94f51b-661f-4083-aa2d-04f5b2f7043d', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:37 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2f32d305-74ed-45a7-b528-a99c1ceff087 1073741824 Jul 23 22:38:37 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5bce9d-0c5b-4864-92f8-c1c75014c2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:37 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Volume volume-8d94f51b-661f-4083-aa2d-04f5b2f7043d (8d94f51b-661f-4083-aa2d-04f5b2f7043d): created successfully Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5bce9d-0c5b-4864-92f8-c1c75014c2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Flow 'volume_create_manager' (e36f4a00-063b-4a93-9b54-69f651974f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:37 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-20d7823e-2089-46ab-af9d-88f57af04dc6 tempest-CreateVolumesFromImageTest-516977014 None] Created volume successfully. Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:37 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2f32d305-74ed-45a7-b528-a99c1ceff087 1073741824" returned: 0 in 0.622s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2f32d305-74ed-45a7-b528-a99c1ceff087 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:37 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2f32d305-74ed-45a7-b528-a99c1ceff087 Jul 23 22:38:37 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Flow 'volume_create_manager' (a864ff6f-fae1-42e3-89cd-8e160a8b49ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550845b6-30ff-4191-b034-64009b414bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550845b6-30ff-4191-b034-64009b414bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48afffaa-6242-4514-88c7-eceb9f22574f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63edae3a58e04e5b9aa81e5a1e41028b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:38Z,use_quota=True,user_id='f266f74d1ed54cc7bd5916558fcdebaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d811379b-6671-4fce-a358-0bc79cb9640d),volume_type_id=d811379b-6671-4fce-a358-0bc79cb9640d)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:37 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75cc380-d724-4fda-9b7d-e32643c5288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75cc380-d724-4fda-9b7d-e32643c5288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0a3149-36a9-44d5-b178-bad9a4235963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.image.glance [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Creating Keystone auth plugin from conf {{(pid=88308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2f32d305-74ed-45a7-b528-a99c1ceff087" returned: 0 in 0.311s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.851s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-639703561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67a22238eab843b0b331478da02ea2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:35Z,use_quota=True,user_id='ccc27ca538964dd5a99e29d8671124d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Creating volume 7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:37 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:38:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3bca1fe-f957-4fcd-b361-138afb79d0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f32d305-74ed-45a7-b528-a99c1ceff087', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ef593e-e704-4b76-b169-64b719f64594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:38 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d 1073741824 Jul 23 22:38:38 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:38 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Volume volume-2f32d305-74ed-45a7-b528-a99c1ceff087 (2f32d305-74ed-45a7-b528-a99c1ceff087): created successfully Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ef593e-e704-4b76-b169-64b719f64594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Flow 'volume_create_manager' (3b20c33c-3672-488f-9886-7435a726a2c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:38 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-089297e6-36aa-49da-a956-193899db66f3 tempest-CreateVolumesFromImageTest-516977014 None] Created volume successfully. Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0a3149-36a9-44d5-b178-bad9a4235963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '48afffaa-6242-4514-88c7-eceb9f22574f', 'volume_name': 'volume-48afffaa-6242-4514-88c7-eceb9f22574f', 'volume_size': 1, 'image_id': '8de04255-b647-4853-a972-ccb064eb3cd8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8de04255-b647-4853-a972-ccb064eb3cd8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '244c4c2ea57faea34bd0dc9a200c52e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '63edae3a58e04e5b9aa81e5a1e41028b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'df7cbcf91eb0185d934318cbb08b95b66f4a185cb34ff5b51ff16f1e1fa1a4141a69cf15ae9c1cd263c8e784f37dbac49af2e4becedf1f78dd3a6fd3693a1600', 'id': '8de04255-b647-4853-a972-ccb064eb3cd8', 'created_at': datetime.datetime(2026, 7, 23, 20, 38, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 38, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8de04255-b647-4853-a972-ccb064eb3cd8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4548edcf-d3bc-4181-b5f9-3775b5006e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4548edcf-d3bc-4181-b5f9-3775b5006e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923a8b42-d7e8-4d80-a862-4b63aea51efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:38 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Volume 48afffaa-6242-4514-88c7-eceb9f22574f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-48afffaa-6242-4514-88c7-eceb9f22574f', 'volume_size': 1, 'image_id': '8de04255-b647-4853-a972-ccb064eb3cd8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8de04255-b647-4853-a972-ccb064eb3cd8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '244c4c2ea57faea34bd0dc9a200c52e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '63edae3a58e04e5b9aa81e5a1e41028b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'df7cbcf91eb0185d934318cbb08b95b66f4a185cb34ff5b51ff16f1e1fa1a4141a69cf15ae9c1cd263c8e784f37dbac49af2e4becedf1f78dd3a6fd3693a1600', 'id': '8de04255-b647-4853-a972-ccb064eb3cd8', 'created_at': datetime.datetime(2026, 7, 23, 20, 38, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 38, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8de04255-b647-4853-a972-ccb064eb3cd8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Trying to clone 48afffaa-6242-4514-88c7-eceb9f22574f from image 8de04255-b647-4853-a972-ccb064eb3cd8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8de04255-b647-4853-a972-ccb064eb3cd8', 'metadata': {}}]). {{(pid=88308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 22:38:38 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d 1073741824" returned: 0 in 0.534s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:38 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d Jul 23 22:38:38 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 22:38:38 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Image download 0.00 MB at 0.00 MB/s Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d29cbb9-68a5-442c-9a2e-5175925ae8dc]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:38 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD Jul 23 22:38:38 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:38 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d" returned: 0 in 0.291s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.670s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3aac26-ca7c-49ca-aaec-348ec7b6b148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59421976-0478-414b-9fa4-7ff9ea6d8287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] Creating offline snapshot 9fdb5275-7b81-45df-899b-958ad636dfa8 of volume d3f98d4c-e083-41e1-a628-fad3a53b77a5 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:38:38 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Volume volume-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d (7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d): created successfully Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59421976-0478-414b-9fa4-7ff9ea6d8287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Flow 'volume_create_manager' (550a65e5-c1a6-4e82-b7b9-b77fdb71bb99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6bfb21-3de9-426c-98f7-8f87c753e2c5]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:38 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-95407e20-14e8-443f-8647-2c4b29ba6868 tempest-CreateVolumesFromImageTest-516977014 None] Created volume successfully. Jul 23 22:38:39 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 Jul 23 22:38:39 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:39 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:39 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD Jul 23 22:38:39 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:39 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5" returned: 0 in 0.422s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:39 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8 1G Jul 23 22:38:39 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:39 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Temporary image 8de04255-b647-4853-a972-ccb064eb3cd8 is fetched for user f266f74d1ed54cc7bd5916558fcdebaf. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ee406d-aff7-477c-9cd6-7f009cc3fb61]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "cinder-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "cinder-quobyte-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-quobyte-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b220324-5fff-4639-b4c8-d9e045134fbe]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:39 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD Jul 23 22:38:39 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:39 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d Jul 23 22:38:39 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:39 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8 1G" returned: 0 in 0.517s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:39 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8 Jul 23 22:38:39 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:39 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:40 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD Jul 23 22:38:40 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:40 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d" returned: 0 in 0.423s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:40 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d Jul 23 22:38:40 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:40 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8" returned: 0 in 0.405s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:40 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8 is being set with open permissions: ugo+rw Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:40 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8 Jul 23 22:38:40 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:40 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD" returned: 1 in 0.425s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:40 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d" returned: 0 in 0.338s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-quobyte-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d" released by "delete_volume" :: held 0.815s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Created reservations ['4071c34e-7cc9-49ca-8193-e7e1c46ffc56', '7e54ad28-d9e3-4896-9cfe-ef911b4c47be', 'a9822af4-7da3-41ac-9a1a-fa60297cde3d', 'c1cf052f-8680-4941-a113-e600111206d4'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:38:40 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8" returned: 0 in 0.314s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:40 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.info Jul 23 22:38:40 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:40 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:38:40 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "cinder-2f32d305-74ed-45a7-b528-a99c1ceff087-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-2f32d305-74ed-45a7-b528-a99c1ceff087-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "cinder-quobyte-2f32d305-74ed-45a7-b528-a99c1ceff087" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-quobyte-2f32d305-74ed-45a7-b528-a99c1ceff087" acquired by "delete_volume" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7802b1-cee0-4c4a-a1fc-0a9f27c0cda8]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2f32d305-74ed-45a7-b528-a99c1ceff087 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:40 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.info" returned: 0 in 0.356s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:41 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.info is being set with open permissions: ugo+rw Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:41 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.352s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:38:41 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Deleted volume successfully. Jul 23 22:38:41 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.info Jul 23 22:38:41 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-eceb9bf1-3993-477a-8c0c-59e6ed5f45f3 tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-7a1b40fc-4f7f-427a-8d3e-8b9d9fb2f00d-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:41 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2f32d305-74ed-45a7-b528-a99c1ceff087 Jul 23 22:38:41 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:41 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.info" returned: 0 in 0.279s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.444s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.907s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48afffaa-6242-4514-88c7-eceb9f22574f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63edae3a58e04e5b9aa81e5a1e41028b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:38Z,use_quota=True,user_id='f266f74d1ed54cc7bd5916558fcdebaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d811379b-6671-4fce-a358-0bc79cb9640d),volume_type_id=d811379b-6671-4fce-a358-0bc79cb9640d)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Creating volume 48afffaa-6242-4514-88c7-eceb9f22574f {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:41 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:41 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f 1073741824 Jul 23 22:38:41 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:41 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-debcd82b-f666-4cf9-9093-7cca2276cae9 tempest-CreateVolumesFromSnapshotTest-4572731 None] Create snapshot completed successfully Jul 23 22:38:41 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2f32d305-74ed-45a7-b528-a99c1ceff087" returned: 0 in 0.473s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2f32d305-74ed-45a7-b528-a99c1ceff087 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:41 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2f32d305-74ed-45a7-b528-a99c1ceff087 Jul 23 22:38:41 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:41 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2f32d305-74ed-45a7-b528-a99c1ceff087" returned: 0 in 0.293s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-quobyte-2f32d305-74ed-45a7-b528-a99c1ceff087" released by "delete_volume" :: held 0.816s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Created reservations ['4e952017-dcb2-45a8-9165-1b05e90125c1', 'bf1efda2-2281-4854-ae0b-31be8c2d91d6', '0359277d-9888-4a98-b629-c8a8836bbb80', '54565fc0-bb08-478e-909b-55bea2ec537f'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:38:41 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f 1073741824" returned: 0 in 0.479s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:41 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f Jul 23 22:38:41 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:41 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:38:41 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "cinder-8d94f51b-661f-4083-aa2d-04f5b2f7043d-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-8d94f51b-661f-4083-aa2d-04f5b2f7043d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "cinder-quobyte-8d94f51b-661f-4083-aa2d-04f5b2f7043d" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-quobyte-8d94f51b-661f-4083-aa2d-04f5b2f7043d" acquired by "delete_volume" :: waited 0.045s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:42 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.321s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:38:42 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Deleted volume successfully. Jul 23 22:38:42 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee49cd09-fa8a-4e0d-994b-95ee8908ee97]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d94f51b-661f-4083-aa2d-04f5b2f7043d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f" returned: 0 in 0.402s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f5354725-4f4b-42fa-8581-bcbb8c5677d0 tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-2f32d305-74ed-45a7-b528-a99c1ceff087-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Attempting download of 8de04255-b647-4853-a972-ccb064eb3cd8 ((None, [{'url': 'file:///opt/stack/data/glance/images/8de04255-b647-4853-a972-ccb064eb3cd8', 'metadata': {}}])) to volume 48afffaa-6242-4514-88c7-eceb9f22574f. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0dc21f-9559-4fef-ba41-a6da059a5abf]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8de04255-b647-4853-a972-ccb064eb3cd8_vfyf648t {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:42 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d94f51b-661f-4083-aa2d-04f5b2f7043d Jul 23 22:38:42 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:42 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8de04255-b647-4853-a972-ccb064eb3cd8_vfyf648t Jul 23 22:38:42 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:42 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d94f51b-661f-4083-aa2d-04f5b2f7043d" returned: 0 in 0.444s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d94f51b-661f-4083-aa2d-04f5b2f7043d {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:42 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d94f51b-661f-4083-aa2d-04f5b2f7043d Jul 23 22:38:42 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:42 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8de04255-b647-4853-a972-ccb064eb3cd8_vfyf648t" returned: 0 in 0.447s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8de04255-b647-4853-a972-ccb064eb3cd8_vfyf648t {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:42 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8de04255-b647-4853-a972-ccb064eb3cd8_vfyf648t Jul 23 22:38:42 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:42 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Flow 'volume_create_manager' (960b45a6-3058-4545-b046-30de5e42adc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4abe8c4-c210-4420-b406-1a1a4f7250fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:43 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8d94f51b-661f-4083-aa2d-04f5b2f7043d" returned: 0 in 0.380s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4abe8c4-c210-4420-b406-1a1a4f7250fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1800909460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969d80b1-22b7-490b-80e5-91edce7710e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5cedf23a7b404ca3c15905476fa116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:43Z,use_quota=True,user_id='d0d1c88a1f2945d2bba2b0b591b29030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53449909-cbf0-4af4-a740-2f0633f9ac61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53449909-cbf0-4af4-a740-2f0633f9ac61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e730719-bea3-4a72-b546-31a5e2af6f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e730719-bea3-4a72-b546-31a5e2af6f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '969d80b1-22b7-490b-80e5-91edce7710e7', 'volume_name': 'volume-969d80b1-22b7-490b-80e5-91edce7710e7', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b0912f-ab33-4bf5-8428-e5cc2dc9078a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b0912f-ab33-4bf5-8428-e5cc2dc9078a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a07ff82-bbcc-4ae5-b071-7b4c3fedf03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:43 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume 969d80b1-22b7-490b-80e5-91edce7710e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-969d80b1-22b7-490b-80e5-91edce7710e7', 'volume_size': 1} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1800909460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969d80b1-22b7-490b-80e5-91edce7710e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5cedf23a7b404ca3c15905476fa116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:43Z,use_quota=True,user_id='d0d1c88a1f2945d2bba2b0b591b29030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Creating volume 969d80b1-22b7-490b-80e5-91edce7710e7 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:43 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-969d80b1-22b7-490b-80e5-91edce7710e7 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-quobyte-8d94f51b-661f-4083-aa2d-04f5b2f7043d" released by "delete_volume" :: held 0.974s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:43 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-969d80b1-22b7-490b-80e5-91edce7710e7 1073741824 Jul 23 22:38:43 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Created reservations ['8717b658-f2df-432b-b130-a7055bc0ac29', 'c585c50e-859d-4486-92b2-7e38ede4d1c2', 'f4844d41-e706-4c45-a153-67ca5bbef9a5', '6bad20d4-4881-417d-afb0-1fa97a085ebe'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:38:43 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8de04255-b647-4853-a972-ccb064eb3cd8_vfyf648t" returned: 1 in 0.580s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8de04255-b647-4853-a972-ccb064eb3cd8_vfyf648t' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f928526-c4db-406d-b644-13f3891db93f]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:43 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:38:43 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:43 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD Jul 23 22:38:43 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Flow 'volume_create_manager' (6fca9055-f4b1-4467-9e7b-5d0efa86ac15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369a24a5-8623-4192-bcac-50b63a889d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369a24a5-8623-4192-bcac-50b63a889d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-495170182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0974434-95e8-4f16-959e-66e72b82ab15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5cedf23a7b404ca3c15905476fa116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:44Z,use_quota=True,user_id='d0d1c88a1f2945d2bba2b0b591b29030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a181f3-6fa5-4110-a2d5-5c9c33587829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a181f3-6fa5-4110-a2d5-5c9c33587829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521d18c6-6052-4294-ab07-bd331da3118f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521d18c6-6052-4294-ab07-bd331da3118f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0974434-95e8-4f16-959e-66e72b82ab15', 'volume_name': 'volume-e0974434-95e8-4f16-959e-66e72b82ab15', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a92b2a-98ad-4e9a-823a-eba10664827b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:43 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a92b2a-98ad-4e9a-823a-eba10664827b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ec4135-a5e4-45c4-a857-8b73b7fa2218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:43 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume e0974434-95e8-4f16-959e-66e72b82ab15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0974434-95e8-4f16-959e-66e72b82ab15', 'volume_size': 1} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-969d80b1-22b7-490b-80e5-91edce7710e7 1073741824" returned: 0 in 0.716s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:43 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-969d80b1-22b7-490b-80e5-91edce7710e7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:43 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.457s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:43 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-969d80b1-22b7-490b-80e5-91edce7710e7 Jul 23 22:38:43 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:38:43 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Deleted volume successfully. Jul 23 22:38:43 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-03471dd6-2a5e-4504-aba2-93148eb77e8d tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-8d94f51b-661f-4083-aa2d-04f5b2f7043d-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:44 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD Jul 23 22:38:44 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:44 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-969d80b1-22b7-490b-80e5-91edce7710e7" returned: 0 in 0.362s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.441s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-495170182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0974434-95e8-4f16-959e-66e72b82ab15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5cedf23a7b404ca3c15905476fa116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:44Z,use_quota=True,user_id='d0d1c88a1f2945d2bba2b0b591b29030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Creating volume e0974434-95e8-4f16-959e-66e72b82ab15 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:44 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e0974434-95e8-4f16-959e-66e72b82ab15 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:44 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a07ff82-bbcc-4ae5-b071-7b4c3fedf03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969d80b1-22b7-490b-80e5-91edce7710e7', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253b9cb4-c3fc-413e-bf72-0471214a5f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:44 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e0974434-95e8-4f16-959e-66e72b82ab15 1073741824 Jul 23 22:38:44 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "cinder-b4e0f3ef-71d9-4273-aba5-d75dfa538c28-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD" returned: 1 in 0.516s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] 8de04255-b647-4853-a972-ccb064eb3cd8 was raw, converting to raw {{(pid=88308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:44 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume volume-969d80b1-22b7-490b-80e5-91edce7710e7 (969d80b1-22b7-490b-80e5-91edce7710e7): created successfully Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253b9cb4-c3fc-413e-bf72-0471214a5f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Flow 'volume_create_manager' (960b45a6-3058-4545-b046-30de5e42adc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:44 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f Jul 23 22:38:44 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-b4e0f3ef-71d9-4273-aba5-d75dfa538c28-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:44 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-90fb9150-fa45-4a75-a281-a45f50811d60 tempest-CreateVolumesFromSnapshotTest-4572731 None] Created volume successfully. Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "cinder-quobyte-b4e0f3ef-71d9-4273-aba5-d75dfa538c28" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-quobyte-b4e0f3ef-71d9-4273-aba5-d75dfa538c28" acquired by "delete_volume" :: waited 0.034s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffe903c-34f4-4db6-850d-2fc9de1915bd]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b4e0f3ef-71d9-4273-aba5-d75dfa538c28 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:44 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b4e0f3ef-71d9-4273-aba5-d75dfa538c28 Jul 23 22:38:44 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:44 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f" returned: 0 in 0.469s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8de04255-b647-4853-a972-ccb064eb3cd8_pz1wncbsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:38:44 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 22:38:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:44 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f 1G Jul 23 22:38:44 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:45 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e0974434-95e8-4f16-959e-66e72b82ab15 1073741824" returned: 0 in 0.755s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Flow 'volume_create_manager' (c9fdac91-591a-43b8-bf74-8ef6ebe7361a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4ffc74-b97b-4d60-8a9b-44ac25e1d993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4ffc74-b97b-4d60-8a9b-44ac25e1d993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-13397287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2d6aec-7665-4298-b044-103599d2d7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5cedf23a7b404ca3c15905476fa116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:45Z,use_quota=True,user_id='d0d1c88a1f2945d2bba2b0b591b29030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:45 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3658aef-1d9a-4fc9-a4b9-9bd20796debc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3658aef-1d9a-4fc9-a4b9-9bd20796debc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a07d27-756b-4a41-aeb0-e4a96b50696f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a07d27-756b-4a41-aeb0-e4a96b50696f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a2d6aec-7665-4298-b044-103599d2d7b5', 'volume_name': 'volume-2a2d6aec-7665-4298-b044-103599d2d7b5', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb25c4c-bb3a-4780-a191-c1ce964d6158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb25c4c-bb3a-4780-a191-c1ce964d6158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf057e9-8192-4ae8-a937-b2c01a76de7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:45 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume 2a2d6aec-7665-4298-b044-103599d2d7b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a2d6aec-7665-4298-b044-103599d2d7b5', 'volume_size': 1} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Flow 'volume_create_manager' (09aa05df-a698-4502-bb0f-b726752f04f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8c3e48-7483-4ed4-ad6d-8b00253d9050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b4e0f3ef-71d9-4273-aba5-d75dfa538c28" returned: 0 in 0.652s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b4e0f3ef-71d9-4273-aba5-d75dfa538c28 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8c3e48-7483-4ed4-ad6d-8b00253d9050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-645703945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5cedf23a7b404ca3c15905476fa116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:45Z,use_quota=True,user_id='d0d1c88a1f2945d2bba2b0b591b29030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3f89d6-17b5-407c-a899-81fe44197910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3f89d6-17b5-407c-a899-81fe44197910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:45 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b4e0f3ef-71d9-4273-aba5-d75dfa538c28 Jul 23 22:38:45 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7191c197-052e-4d9c-abe4-ef81d5992bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7191c197-052e-4d9c-abe4-ef81d5992bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b', 'volume_name': 'volume-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a3727d-d199-409a-9a47-b343aa610e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a3727d-d199-409a-9a47-b343aa610e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc0ab7c-97dc-4298-a82a-f8a2e29ea03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:45 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume 5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b', 'volume_size': 1} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e0974434-95e8-4f16-959e-66e72b82ab15 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:45 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:45 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e0974434-95e8-4f16-959e-66e72b82ab15 Jul 23 22:38:45 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f 1G" returned: 0 in 0.451s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Flow 'volume_create_manager' (576d195a-6445-45b9-9cff-b42998758ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6931ccfd-3efb-4c15-9758-914847730a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c200c9a3-ba03-4fce-868c-5fab7a5ccf98]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6931ccfd-3efb-4c15-9758-914847730a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611609139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db894dc-d7f9-4632-990d-25ed4a2824a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5cedf23a7b404ca3c15905476fa116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:45Z,use_quota=True,user_id='d0d1c88a1f2945d2bba2b0b591b29030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9488802f-b47a-45e7-9b86-46f088c39176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9488802f-b47a-45e7-9b86-46f088c39176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51da6ae1-81e6-4782-9337-0f17daea0b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51da6ae1-81e6-4782-9337-0f17daea0b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db894dc-d7f9-4632-990d-25ed4a2824a1', 'volume_name': 'volume-8db894dc-d7f9-4632-990d-25ed4a2824a1', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78ddf10-b07c-4d86-ae5b-9b057f9855fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78ddf10-b07c-4d86-ae5b-9b057f9855fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a6e35e-201b-4ff8-8a3f-8930315fdc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:45 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume 8db894dc-d7f9-4632-990d-25ed4a2824a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db894dc-d7f9-4632-990d-25ed4a2824a1', 'volume_size': 1} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:45 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:45 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f Jul 23 22:38:45 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-b4e0f3ef-71d9-4273-aba5-d75dfa538c28" returned: 0 in 0.271s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-quobyte-b4e0f3ef-71d9-4273-aba5-d75dfa538c28" released by "delete_volume" :: held 0.986s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:45 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e0974434-95e8-4f16-959e-66e72b82ab15" returned: 0 in 0.314s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.418s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-13397287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2d6aec-7665-4298-b044-103599d2d7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5cedf23a7b404ca3c15905476fa116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:45Z,use_quota=True,user_id='d0d1c88a1f2945d2bba2b0b591b29030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Creating volume 2a2d6aec-7665-4298-b044-103599d2d7b5 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:45 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2a2d6aec-7665-4298-b044-103599d2d7b5 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ec4135-a5e4-45c4-a857-8b73b7fa2218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0974434-95e8-4f16-959e-66e72b82ab15', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10742603-bf33-426d-87d3-2471aab4f30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:45 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2a2d6aec-7665-4298-b044-103599d2d7b5 1073741824 Jul 23 22:38:45 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:45 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume volume-e0974434-95e8-4f16-959e-66e72b82ab15 (e0974434-95e8-4f16-959e-66e72b82ab15): created successfully Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10742603-bf33-426d-87d3-2471aab4f30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Flow 'volume_create_manager' (6fca9055-f4b1-4467-9e7b-5d0efa86ac15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Created reservations ['aaa14731-0513-4356-8c26-d484f8fcd656', 'fee2f435-a2c5-4637-aa72-7f42f3c3867f', 'bea44c3b-4919-42a5-a778-2758148c235c', '08e251cf-c226-4f8f-8a49-97d289ab39c9'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:38:45 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e2052848-1aa6-4437-bbfb-fd439c3c743e tempest-CreateVolumesFromSnapshotTest-4572731 None] Created volume successfully. Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:45 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:38:45 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:45 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f" returned: 0 in 0.457s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:45 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f Jul 23 22:38:45 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:46 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.274s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:38:46 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Deleted volume successfully. Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-47869459-6161-44e3-9acf-8c085c95a160 tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-b4e0f3ef-71d9-4273-aba5-d75dfa538c28-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:46 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2a2d6aec-7665-4298-b044-103599d2d7b5 1073741824" returned: 0 in 0.537s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2a2d6aec-7665-4298-b044-103599d2d7b5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:46 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f" returned: 1 in 0.403s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Downloaded image 8de04255-b647-4853-a972-ccb064eb3cd8 ((None, [{'url': 'file:///opt/stack/data/glance/images/8de04255-b647-4853-a972-ccb064eb3cd8', 'metadata': {}}])) to volume 48afffaa-6242-4514-88c7-eceb9f22574f successfully. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Temporary image 8de04255-b647-4853-a972-ccb064eb3cd8 for user f266f74d1ed54cc7bd5916558fcdebaf is deleted. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Marking volume 48afffaa-6242-4514-88c7-eceb9f22574f as bootable. {{(pid=88308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 22:38:46 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2a2d6aec-7665-4298-b044-103599d2d7b5 Jul 23 22:38:46 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Copying metadata from image 8de04255-b647-4853-a972-ccb064eb3cd8 to 48afffaa-6242-4514-88c7-eceb9f22574f. {{(pid=88308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Creating volume glance metadata for volume 48afffaa-6242-4514-88c7-eceb9f22574f backed by image 8de04255-b647-4853-a972-ccb064eb3cd8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8de04255-b647-4853-a972-ccb064eb3cd8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '244c4c2ea57faea34bd0dc9a200c52e5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923a8b42-d7e8-4d80-a862-4b63aea51efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48afffaa-6242-4514-88c7-eceb9f22574f', 'volume_size': 1, 'image_id': '8de04255-b647-4853-a972-ccb064eb3cd8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8de04255-b647-4853-a972-ccb064eb3cd8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '244c4c2ea57faea34bd0dc9a200c52e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '63edae3a58e04e5b9aa81e5a1e41028b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'df7cbcf91eb0185d934318cbb08b95b66f4a185cb34ff5b51ff16f1e1fa1a4141a69cf15ae9c1cd263c8e784f37dbac49af2e4becedf1f78dd3a6fd3693a1600', 'id': '8de04255-b647-4853-a972-ccb064eb3cd8', 'created_at': datetime.datetime(2026, 7, 23, 20, 38, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 38, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8de04255-b647-4853-a972-ccb064eb3cd8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc68b68-532b-4f50-99e6-193cadadca48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:46 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Volume volume-48afffaa-6242-4514-88c7-eceb9f22574f (48afffaa-6242-4514-88c7-eceb9f22574f): created successfully Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc68b68-532b-4f50-99e6-193cadadca48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Flow 'volume_create_manager' (a864ff6f-fae1-42e3-89cd-8e160a8b49ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:46 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-87c3dcd7-7d8d-42f7-977a-2d4632a7a1a9 tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Created volume successfully. Jul 23 22:38:46 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2a2d6aec-7665-4298-b044-103599d2d7b5" returned: 0 in 0.263s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.182s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-645703945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5cedf23a7b404ca3c15905476fa116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:45Z,use_quota=True,user_id='d0d1c88a1f2945d2bba2b0b591b29030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Creating volume 5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:46 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf057e9-8192-4ae8-a937-b2c01a76de7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a2d6aec-7665-4298-b044-103599d2d7b5', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9e2f63-0c9b-4f48-99cb-858d366a0588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:46 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b 1073741824 Jul 23 22:38:46 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:46 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume volume-2a2d6aec-7665-4298-b044-103599d2d7b5 (2a2d6aec-7665-4298-b044-103599d2d7b5): created successfully Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9e2f63-0c9b-4f48-99cb-858d366a0588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Flow 'volume_create_manager' (c9fdac91-591a-43b8-bf74-8ef6ebe7361a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:46 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f100ea79-83b1-46c6-a1fb-6529ca42302c tempest-CreateVolumesFromSnapshotTest-4572731 None] Created volume successfully. Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Acquiring lock "cinder-48afffaa-6242-4514-88c7-eceb9f22574f-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Lock "cinder-48afffaa-6242-4514-88c7-eceb9f22574f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Acquiring lock "cinder-quobyte-48afffaa-6242-4514-88c7-eceb9f22574f" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Lock "cinder-quobyte-48afffaa-6242-4514-88c7-eceb9f22574f" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa003ad-1343-4e44-bbdb-f60951761be0]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "cinder-dda4a88d-fd76-47a4-a320-7219f48fe0fb-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-dda4a88d-fd76-47a4-a320-7219f48fe0fb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "cinder-quobyte-dda4a88d-fd76-47a4-a320-7219f48fe0fb" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:47 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f Jul 23 22:38:47 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-quobyte-dda4a88d-fd76-47a4-a320-7219f48fe0fb" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:47 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b 1073741824" returned: 0 in 0.586s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f59b5d-c3de-43dc-873b-6008fb808493]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dda4a88d-fd76-47a4-a320-7219f48fe0fb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:47 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b Jul 23 22:38:47 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:47 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dda4a88d-fd76-47a4-a320-7219f48fe0fb Jul 23 22:38:47 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:47 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f" returned: 0 in 0.550s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:47 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b" returned: 0 in 0.347s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.084s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611609139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db894dc-d7f9-4632-990d-25ed4a2824a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5cedf23a7b404ca3c15905476fa116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:45Z,use_quota=True,user_id='d0d1c88a1f2945d2bba2b0b591b29030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Creating volume 8db894dc-d7f9-4632-990d-25ed4a2824a1 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:47 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8db894dc-d7f9-4632-990d-25ed4a2824a1 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc0ab7c-97dc-4298-a82a-f8a2e29ea03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:47 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8db894dc-d7f9-4632-990d-25ed4a2824a1 1073741824 Jul 23 22:38:47 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68d4cfe-9b66-499b-9cec-d7abe54ad437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:47 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:47 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume volume-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b (5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b): created successfully Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68d4cfe-9b66-499b-9cec-d7abe54ad437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Flow 'volume_create_manager' (09aa05df-a698-4502-bb0f-b726752f04f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:47 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f Jul 23 22:38:47 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dda4a88d-fd76-47a4-a320-7219f48fe0fb" returned: 0 in 0.501s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dda4a88d-fd76-47a4-a320-7219f48fe0fb {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:47 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ee6037fc-309b-4ec5-8b72-83bc7f77c4f5 tempest-CreateVolumesFromSnapshotTest-4572731 None] Created volume successfully. Jul 23 22:38:47 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dda4a88d-fd76-47a4-a320-7219f48fe0fb Jul 23 22:38:47 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:47 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f" returned: 1 in 0.402s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:47 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-dda4a88d-fd76-47a4-a320-7219f48fe0fb" returned: 0 in 0.269s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-quobyte-dda4a88d-fd76-47a4-a320-7219f48fe0fb" released by "delete_volume" :: held 0.843s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:47 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f Jul 23 22:38:47 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Created reservations ['df45b730-9fdc-471a-a382-5f3a2e7d8635', '0dcb2653-f08e-4c38-8055-ac722beea8d6', 'fe4976ad-bb79-4c9a-af6d-983e51a4d168', '51540406-c1af-452d-af0e-37c715e7bccd'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:38:47 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8db894dc-d7f9-4632-990d-25ed4a2824a1 1073741824" returned: 0 in 0.463s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8db894dc-d7f9-4632-990d-25ed4a2824a1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:48 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8db894dc-d7f9-4632-990d-25ed4a2824a1 Jul 23 22:38:48 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:48 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:38:48 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:48 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-48afffaa-6242-4514-88c7-eceb9f22574f" returned: 0 in 0.302s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Lock "cinder-quobyte-48afffaa-6242-4514-88c7-eceb9f22574f" released by "delete_volume" :: held 1.355s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Created reservations ['5a25e26e-a43b-422d-ae95-1ecc70e2c372', '50fb5cd0-e794-4a1a-8f7f-520f6a6e9a07', '3607c891-acfa-42d5-b72a-46caf096b604', '5c491e8a-b6a4-446e-8808-d02bba859bb4'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:38:48 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8db894dc-d7f9-4632-990d-25ed4a2824a1" returned: 0 in 0.283s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a6e35e-201b-4ff8-8a3f-8930315fdc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db894dc-d7f9-4632-990d-25ed4a2824a1', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec40102-504a-4c75-abe1-30b378c65f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:48 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Volume volume-8db894dc-d7f9-4632-990d-25ed4a2824a1 (8db894dc-d7f9-4632-990d-25ed4a2824a1): created successfully Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec40102-504a-4c75-abe1-30b378c65f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Flow 'volume_create_manager' (576d195a-6445-45b9-9cff-b42998758ce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:48 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-fa276234-ffbd-4c18-a083-2a518827c6ac tempest-CreateVolumesFromSnapshotTest-4572731 None] Created volume successfully. Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:48 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.383s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:38:48 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Deleted volume successfully. Jul 23 22:38:48 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:38:48 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-407e2819-76af-4434-b95e-5084549a6ce8 tempest-CreateVolumesFromImageTest-516977014 None] Lock "cinder-dda4a88d-fd76-47a4-a320-7219f48fe0fb-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "cinder-8db894dc-d7f9-4632-990d-25ed4a2824a1-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:48 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-8db894dc-d7f9-4632-990d-25ed4a2824a1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.335s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:38:48 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Deleted volume successfully. Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2c833166-b7a0-40cd-8b80-cd15ca29998e tempest-VolumeAndVolumeTypeFromImageTest-1215823936 None] Lock "cinder-48afffaa-6242-4514-88c7-eceb9f22574f-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "cinder-quobyte-8db894dc-d7f9-4632-990d-25ed4a2824a1" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-quobyte-8db894dc-d7f9-4632-990d-25ed4a2824a1" acquired by "delete_volume" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9f6801-7973-4dee-9338-6af835152c9e]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8db894dc-d7f9-4632-990d-25ed4a2824a1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:49 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8db894dc-d7f9-4632-990d-25ed4a2824a1 Jul 23 22:38:49 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:49 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8db894dc-d7f9-4632-990d-25ed4a2824a1" returned: 0 in 0.534s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8db894dc-d7f9-4632-990d-25ed4a2824a1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:49 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8db894dc-d7f9-4632-990d-25ed4a2824a1 Jul 23 22:38:49 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:49 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-8db894dc-d7f9-4632-990d-25ed4a2824a1" returned: 0 in 0.344s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-quobyte-8db894dc-d7f9-4632-990d-25ed4a2824a1" released by "delete_volume" :: held 0.936s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:49 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Created reservations ['26dce27f-0325-4f31-8995-84db70a9f1da', '789d4903-870e-4c20-b4f8-1955cc82906b', '0025e574-286f-4bea-8ba4-dfa8f36af2e0', '8be7d8a4-362e-41a1-8dbf-7ea2e59d179c'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:38:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:50 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:38:50 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:50 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.354s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:50 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:38:50 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Deleted volume successfully. Jul 23 22:38:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-65c91402-0443-4522-9506-1e0b54f5d774 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-8db894dc-d7f9-4632-990d-25ed4a2824a1-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "cinder-2a2d6aec-7665-4298-b044-103599d2d7b5-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-2a2d6aec-7665-4298-b044-103599d2d7b5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "cinder-quobyte-2a2d6aec-7665-4298-b044-103599d2d7b5" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-quobyte-2a2d6aec-7665-4298-b044-103599d2d7b5" acquired by "delete_volume" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:51 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cb8608-a2d2-4011-8878-254ea7a94a1e]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2a2d6aec-7665-4298-b044-103599d2d7b5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:51 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2a2d6aec-7665-4298-b044-103599d2d7b5 Jul 23 22:38:51 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:51 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2a2d6aec-7665-4298-b044-103599d2d7b5" returned: 0 in 0.452s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2a2d6aec-7665-4298-b044-103599d2d7b5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:51 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2a2d6aec-7665-4298-b044-103599d2d7b5 Jul 23 22:38:51 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:51 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2a2d6aec-7665-4298-b044-103599d2d7b5" returned: 0 in 0.321s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-quobyte-2a2d6aec-7665-4298-b044-103599d2d7b5" released by "delete_volume" :: held 0.832s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Flow 'volume_create_manager' (4a0950b4-a00f-474e-9910-19dcf4ba1b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55b5012-a40e-49a0-8181-12c1e66652bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55b5012-a40e-49a0-8181-12c1e66652bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-422422958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d80a25ef-4f0d-4694-969e-2e469a6de624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f7ce221bc040d5a900daf172ba66c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:52Z,use_quota=True,user_id='b6d2287ae4984c35a64099cf65a4dde0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96916297-8565-48e1-a4aa-e66b6ec6ff1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96916297-8565-48e1-a4aa-e66b6ec6ff1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5284daf-9a4c-4084-b4a6-18a802c57209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5284daf-9a4c-4084-b4a6-18a802c57209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd80a25ef-4f0d-4694-969e-2e469a6de624', 'volume_name': 'volume-d80a25ef-4f0d-4694-969e-2e469a6de624', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52962eeb-f78b-464a-a49d-a847fda51fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52962eeb-f78b-464a-a49d-a847fda51fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba95a126-b2ba-489f-9732-2b7359c823d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:52 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Volume d80a25ef-4f0d-4694-969e-2e469a6de624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d80a25ef-4f0d-4694-969e-2e469a6de624', 'volume_size': 1} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-422422958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d80a25ef-4f0d-4694-969e-2e469a6de624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f7ce221bc040d5a900daf172ba66c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:52Z,use_quota=True,user_id='b6d2287ae4984c35a64099cf65a4dde0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Creating volume d80a25ef-4f0d-4694-969e-2e469a6de624 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:52 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Created reservations ['cd5e4262-5ab1-49af-b66e-7efd11fe1990', '3427ab95-1779-4683-84b9-e236b353d70d', 'ac963384-a007-45f7-bfd0-3ee90ec60971', 'bb5d396d-b832-4901-af3b-fdc15e2dbe0e'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:38:52 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 1073741824 Jul 23 22:38:52 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:52 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:38:52 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:52 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.372s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:38:52 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Deleted volume successfully. Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ceb5380a-4255-406c-b2fa-33c73fa5d04e tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-2a2d6aec-7665-4298-b044-103599d2d7b5-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:52 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 1073741824" returned: 0 in 0.605s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:52 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 Jul 23 22:38:52 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:53 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624" returned: 0 in 0.286s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba95a126-b2ba-489f-9732-2b7359c823d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d80a25ef-4f0d-4694-969e-2e469a6de624', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba117462-12e0-47c1-9a18-bea0c8909c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:53 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Volume volume-d80a25ef-4f0d-4694-969e-2e469a6de624 (d80a25ef-4f0d-4694-969e-2e469a6de624): created successfully Jul 23 22:38:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba117462-12e0-47c1-9a18-bea0c8909c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:53 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Flow 'volume_create_manager' (4a0950b4-a00f-474e-9910-19dcf4ba1b2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:53 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b09a4ff2-8ad2-4638-ac35-89e7a06802d8 tempest-VolumeDependencyTests-72732391 None] Created volume successfully. Jul 23 22:38:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "cinder-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "cinder-quobyte-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-quobyte-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:53 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[446a796b-031f-452e-8287-76c2c6da9a93]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:53 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b Jul 23 22:38:53 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:53 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b" returned: 0 in 0.435s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:53 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b Jul 23 22:38:53 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Flow 'volume_create_manager' (1766e63f-5a31-4e5d-921d-2a76518e2042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b84e53-ec62-4c45-805b-473b2e8654cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b84e53-ec62-4c45-805b-473b2e8654cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-528623916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fff7565-6484-49d1-a720-ba2189f793ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b9c8d35cf64104a21ace8e2b5a0866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:54Z,use_quota=True,user_id='b50e3c6539db4468a7fe8b205c1aff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9805cbe6-ce87-43e4-a5c1-306c9daca5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9805cbe6-ce87-43e4-a5c1-306c9daca5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee0a4d6-b97a-4942-bcc8-a1120f9d4713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee0a4d6-b97a-4942-bcc8-a1120f9d4713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fff7565-6484-49d1-a720-ba2189f793ce', 'volume_name': 'volume-2fff7565-6484-49d1-a720-ba2189f793ce', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b295b48-f3bb-49f3-a69e-d72c6d35f6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b295b48-f3bb-49f3-a69e-d72c6d35f6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b426bef-975f-45d8-8dee-9259b97e680e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:54 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Volume 2fff7565-6484-49d1-a720-ba2189f793ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fff7565-6484-49d1-a720-ba2189f793ce', 'volume_size': 1} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-528623916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fff7565-6484-49d1-a720-ba2189f793ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b9c8d35cf64104a21ace8e2b5a0866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:54Z,use_quota=True,user_id='b50e3c6539db4468a7fe8b205c1aff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Creating volume 2fff7565-6484-49d1-a720-ba2189f793ce {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:54 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2fff7565-6484-49d1-a720-ba2189f793ce 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:54 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2fff7565-6484-49d1-a720-ba2189f793ce 1073741824 Jul 23 22:38:54 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:54 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b" returned: 0 in 0.333s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-quobyte-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b" released by "delete_volume" :: held 0.832s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Created reservations ['b00884c6-44db-43f3-97fd-07c52d368244', 'f90517ec-4416-4dea-86c0-f0e277104734', '9cc8d46a-7de2-49ac-8fb0-4b8d8c730ad6', '434cbb07-10a7-414f-81f4-86a4f471c94b'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:54 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:38:54 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "cinder-e0974434-95e8-4f16-959e-66e72b82ab15-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-e0974434-95e8-4f16-959e-66e72b82ab15-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "cinder-quobyte-e0974434-95e8-4f16-959e-66e72b82ab15" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-quobyte-e0974434-95e8-4f16-959e-66e72b82ab15" acquired by "delete_volume" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd406b83-bd9b-446b-a2cd-660e113915bd]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e0974434-95e8-4f16-959e-66e72b82ab15 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:54 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.317s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:38:54 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Deleted volume successfully. Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f474cb3f-5a09-41ad-8b48-f3cc29ed3fce tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-5a0cbcf7-ba52-49d6-8c0a-6f420fd4f58b-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:54 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2fff7565-6484-49d1-a720-ba2189f793ce 1073741824" returned: 0 in 0.607s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2fff7565-6484-49d1-a720-ba2189f793ce {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:54 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2fff7565-6484-49d1-a720-ba2189f793ce Jul 23 22:38:54 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:54 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e0974434-95e8-4f16-959e-66e72b82ab15 Jul 23 22:38:54 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Flow 'volume_create_manager' (21d76cb0-e0eb-40e3-8160-749d3e3e6b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156eb3a1-deeb-4969-a11a-1169b12e9dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156eb3a1-deeb-4969-a11a-1169b12e9dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8ae4e5-d01e-4167-aa97-f354880920e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965f72f4ba824aa3b1e48d470854a67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:55Z,use_quota=True,user_id='6b3d179c0e974559a18d6e735ce981d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee42e1c3-a111-43c3-99c3-e180fee77d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee42e1c3-a111-43c3-99c3-e180fee77d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d97cc03-3665-4aff-b178-716b8398e8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d97cc03-3665-4aff-b178-716b8398e8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e8ae4e5-d01e-4167-aa97-f354880920e0', 'volume_name': 'volume-2e8ae4e5-d01e-4167-aa97-f354880920e0', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39cb948f-00a1-411f-bcff-6c3399b694ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39cb948f-00a1-411f-bcff-6c3399b694ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc72774-85fd-495f-92a8-529d4e064956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:54 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Volume 2e8ae4e5-d01e-4167-aa97-f354880920e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e8ae4e5-d01e-4167-aa97-f354880920e0', 'volume_size': 1} Jul 23 22:38:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:55 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2fff7565-6484-49d1-a720-ba2189f793ce" returned: 0 in 0.273s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.771s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b426bef-975f-45d8-8dee-9259b97e680e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fff7565-6484-49d1-a720-ba2189f793ce', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf319151-6b3f-4be8-acd6-19b01c4c99a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:55 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] Creating offline snapshot 6b574844-149b-4fe7-adf7-cfbca6b83158 of volume d80a25ef-4f0d-4694-969e-2e469a6de624 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e0974434-95e8-4f16-959e-66e72b82ab15" returned: 0 in 0.415s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e0974434-95e8-4f16-959e-66e72b82ab15 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06e18c0-589b-4a66-807d-f6e362992055]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:55 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e0974434-95e8-4f16-959e-66e72b82ab15 Jul 23 22:38:55 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Volume volume-2fff7565-6484-49d1-a720-ba2189f793ce (2fff7565-6484-49d1-a720-ba2189f793ce): created successfully Jul 23 22:38:55 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf319151-6b3f-4be8-acd6-19b01c4c99a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Flow 'volume_create_manager' (1766e63f-5a31-4e5d-921d-2a76518e2042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:55 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ce271581-9f80-465b-a031-aae5d712277a tempest-ProjectReaderTests-2044125548 None] Created volume successfully. Jul 23 22:38:55 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 Jul 23 22:38:55 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:55 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e0974434-95e8-4f16-959e-66e72b82ab15" returned: 0 in 0.267s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-quobyte-e0974434-95e8-4f16-959e-66e72b82ab15" released by "delete_volume" :: held 0.729s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Created reservations ['b608f467-6a87-45b1-89bd-c71a579e31e6', '92d46b56-8e5a-4a98-94fa-9e2c211f9ba8', 'c5845c5d-94d9-453a-8fa8-679ffa61c230', 'e11609ad-dd55-4081-af1c-eb8024dff405'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:55 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624" returned: 0 in 0.395s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:55 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:38:55 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:55 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 1G Jul 23 22:38:55 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "cinder-969d80b1-22b7-490b-80e5-91edce7710e7-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-969d80b1-22b7-490b-80e5-91edce7710e7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:55 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.268s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "cinder-quobyte-969d80b1-22b7-490b-80e5-91edce7710e7" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:55 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Deleted volume successfully. Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-quobyte-969d80b1-22b7-490b-80e5-91edce7710e7" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-73766127-c8f7-4849-beb4-374017d46d8d tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-e0974434-95e8-4f16-959e-66e72b82ab15-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[85669d20-c963-488d-8595-5e6a55466851]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-969d80b1-22b7-490b-80e5-91edce7710e7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:55 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 1G" returned: 0 in 0.433s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d80a25ef-4f0d-4694-969e-2e469a6de624 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:55 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-969d80b1-22b7-490b-80e5-91edce7710e7 Jul 23 22:38:55 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:55 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d80a25ef-4f0d-4694-969e-2e469a6de624 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 Jul 23 22:38:55 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:56 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-969d80b1-22b7-490b-80e5-91edce7710e7" returned: 0 in 0.388s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-969d80b1-22b7-490b-80e5-91edce7710e7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:56 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Acquiring lock "cinder-2fff7565-6484-49d1-a720-ba2189f793ce-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d80a25ef-4f0d-4694-969e-2e469a6de624 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158" returned: 0 in 0.313s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:56 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 is being set with open permissions: ugo+rw Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:56 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-969d80b1-22b7-490b-80e5-91edce7710e7 Jul 23 22:38:56 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Lock "cinder-2fff7565-6484-49d1-a720-ba2189f793ce-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:56 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 Jul 23 22:38:56 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Acquiring lock "cinder-quobyte-2fff7565-6484-49d1-a720-ba2189f793ce" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Lock "cinder-quobyte-2fff7565-6484-49d1-a720-ba2189f793ce" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e62432d-4a11-4933-ac17-0096505bf0e9]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2fff7565-6484-49d1-a720-ba2189f793ce {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:56 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-969d80b1-22b7-490b-80e5-91edce7710e7" returned: 0 in 0.275s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:56 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2fff7565-6484-49d1-a720-ba2189f793ce Jul 23 22:38:56 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-quobyte-969d80b1-22b7-490b-80e5-91edce7710e7" released by "delete_volume" :: held 0.717s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:56 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158" returned: 0 in 0.279s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Created reservations ['0fd1f353-9f63-440c-8b99-1cdd3c5f658a', '76e4aad4-e1e3-4d50-886c-936e0802e405', '994352eb-8eb7-49cf-912e-43e9d87d066b', '815af531-a1e2-471a-8c5c-41d3f22ab892'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:38:56 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.info Jul 23 22:38:56 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:56 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:38:56 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:56 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2fff7565-6484-49d1-a720-ba2189f793ce" returned: 0 in 0.376s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2fff7565-6484-49d1-a720-ba2189f793ce {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:56 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2fff7565-6484-49d1-a720-ba2189f793ce Jul 23 22:38:56 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:56 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "cinder-9fdb5275-7b81-45df-899b-958ad636dfa8-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.info" returned: 0 in 0.333s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:56 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.info is being set with open permissions: ugo+rw Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:56 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-9fdb5275-7b81-45df-899b-958ad636dfa8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "cinder-quobyte-d3f98d4c-e083-41e1-a628-fad3a53b77a5" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:56 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.info Jul 23 22:38:56 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.291s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:38:56 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Deleted volume successfully. Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-quobyte-d3f98d4c-e083-41e1-a628-fad3a53b77a5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:56 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "cinder-quobyte-9fdb5275-7b81-45df-899b-958ad636dfa8" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-quobyte-9fdb5275-7b81-45df-899b-958ad636dfa8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Deleting offline snapshot 9fdb5275-7b81-45df-899b-958ad636dfa8 of volume d3f98d4c-e083-41e1-a628-fad3a53b77a5 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] snapshot_file for this snap is: volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1ab7aa0e-5c46-42de-a669-ba79db829a35 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-969d80b1-22b7-490b-80e5-91edce7710e7-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4dede2-e5a5-4192-bc81-9f1c2d33ad56]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:57 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2fff7565-6484-49d1-a720-ba2189f793ce" returned: 0 in 0.305s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Lock "cinder-quobyte-2fff7565-6484-49d1-a720-ba2189f793ce" released by "delete_volume" :: held 0.726s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Created reservations ['65ac6ffb-6401-4df5-ba21-f1db1d7c3dac', 'f102b98c-9f1d-45bd-b339-9b2ee1dc7e02', '98cf7eb7-f199-4011-970d-abbad5a7daca', '5855f337-cd2b-48b8-960c-6425a44ea2bd'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:38:57 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8 Jul 23 22:38:57 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:57 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.info" returned: 0 in 0.275s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.241s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8ae4e5-d01e-4167-aa97-f354880920e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965f72f4ba824aa3b1e48d470854a67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:55Z,use_quota=True,user_id='6b3d179c0e974559a18d6e735ce981d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Creating volume 2e8ae4e5-d01e-4167-aa97-f354880920e0 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:57 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2e8ae4e5-d01e-4167-aa97-f354880920e0 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:57 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2e8ae4e5-d01e-4167-aa97-f354880920e0 1073741824 Jul 23 22:38:57 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:57 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2c9e67dd-91de-433e-89e8-0f5cb1b22cc6 tempest-VolumeDependencyTests-72732391 None] Create snapshot completed successfully Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:57 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:38:57 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:57 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8" returned: 0 in 0.434s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[03de53e0-a7ba-4a21-a733-d625fc67e938]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:57 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.310s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:38:57 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Deleted volume successfully. Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f58be912-82f3-4c41-b76c-06ca492bb657 tempest-ProjectReaderTests-2044125548 None] Lock "cinder-2fff7565-6484-49d1-a720-ba2189f793ce-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:57 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 Jul 23 22:38:57 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:57 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2e8ae4e5-d01e-4167-aa97-f354880920e0 1073741824" returned: 0 in 0.517s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2e8ae4e5-d01e-4167-aa97-f354880920e0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:57 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2e8ae4e5-d01e-4167-aa97-f354880920e0 Jul 23 22:38:57 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:58 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5" returned: 0 in 0.551s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:58 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:58 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8 Jul 23 22:38:58 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2e8ae4e5-d01e-4167-aa97-f354880920e0" returned: 0 in 0.303s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc72774-85fd-495f-92a8-529d4e064956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8ae4e5-d01e-4167-aa97-f354880920e0', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca0da80-c849-4190-af3d-ec9d59baef1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:58 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Volume volume-2e8ae4e5-d01e-4167-aa97-f354880920e0 (2e8ae4e5-d01e-4167-aa97-f354880920e0): created successfully Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca0da80-c849-4190-af3d-ec9d59baef1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Flow 'volume_create_manager' (21d76cb0-e0eb-40e3-8160-749d3e3e6b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:58 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4cc17969-9d9d-4115-8828-dc15dedcf077 tempest-CinderUnicodeTest-17891452 None] Created volume successfully. Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Flow 'volume_create_manager' (1412c0f7-b0a3-4e21-8337-1fd7ef1aecb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457ddfec-8207-4f41-b8c6-fe65095c14ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457ddfec-8207-4f41-b8c6-fe65095c14ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1441471765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487b5345-21d5-497a-8835-5c266879e14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b9c8d35cf64104a21ace8e2b5a0866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:58Z,use_quota=True,user_id='b50e3c6539db4468a7fe8b205c1aff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4db04b-f0ef-473b-ae2d-5eeba5708441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4db04b-f0ef-473b-ae2d-5eeba5708441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c71bbc-a088-487d-9471-ec7cfd1c5aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c71bbc-a088-487d-9471-ec7cfd1c5aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '487b5345-21d5-497a-8835-5c266879e14f', 'volume_name': 'volume-487b5345-21d5-497a-8835-5c266879e14f', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554c5405-38ea-452c-b7a8-7002daf4778e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554c5405-38ea-452c-b7a8-7002daf4778e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ca323f-73d1-403c-ae69-d42a743e9bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:58 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Volume 487b5345-21d5-497a-8835-5c266879e14f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-487b5345-21d5-497a-8835-5c266879e14f', 'volume_size': 1} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1441471765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487b5345-21d5-497a-8835-5c266879e14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b9c8d35cf64104a21ace8e2b5a0866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:58Z,use_quota=True,user_id='b50e3c6539db4468a7fe8b205c1aff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Creating volume 487b5345-21d5-497a-8835-5c266879e14f {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:58 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-487b5345-21d5-497a-8835-5c266879e14f 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:58 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-487b5345-21d5-497a-8835-5c266879e14f 1073741824 Jul 23 22:38:58 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Flow 'volume_create_manager' (3c1b4f3f-1671-49e9-a8e9-d9acf47be3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (710eac96-c991-430b-b4cc-1e0db91c51a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (710eac96-c991-430b-b4cc-1e0db91c51a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-369105746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36d1ace-3057-4f02-8134-86bf6e9d7d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f7ce221bc040d5a900daf172ba66c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6b574844-149b-4fe7-adf7-cfbca6b83158,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:38:58Z,use_quota=True,user_id='b6d2287ae4984c35a64099cf65a4dde0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a58b545-2868-4522-ac0f-512419901067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a58b545-2868-4522-ac0f-512419901067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5b6389-0288-4b44-8af8-f83db1cdff1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5b6389-0288-4b44-8af8-f83db1cdff1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd36d1ace-3057-4f02-8134-86bf6e9d7d81', 'volume_name': 'volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81', 'volume_size': 1, 'snapshot_id': '6b574844-149b-4fe7-adf7-cfbca6b83158'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b59164-d917-4acf-bee6-585162142abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b59164-d917-4acf-bee6-585162142abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (981eb994-371c-4611-9ed4-3bf31c502d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:58 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Volume d36d1ace-3057-4f02-8134-86bf6e9d7d81: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81', 'volume_size': 1, 'snapshot_id': '6b574844-149b-4fe7-adf7-cfbca6b83158'} Jul 23 22:38:58 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8" returned: 0 in 0.384s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:58 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8 Jul 23 22:38:58 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:58 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5.9fdb5275-7b81-45df-899b-958ad636dfa8" returned: 0 in 0.245s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:58 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-quobyte-9fdb5275-7b81-45df-899b-958ad636dfa8" released by "_delete_snapshot" :: held 1.742s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-487b5345-21d5-497a-8835-5c266879e14f 1073741824" returned: 0 in 0.423s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-quobyte-d3f98d4c-e083-41e1-a628-fad3a53b77a5" released by "delete_snapshot" :: held 1.768s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-487b5345-21d5-497a-8835-5c266879e14f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:58 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-487b5345-21d5-497a-8835-5c266879e14f Jul 23 22:38:58 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Created reservations ['78c0e0d4-2e6a-427f-80ad-93c539ec3daa', 'e0595e7e-49b4-48a4-9356-1d035da5166c', '35ff44d7-385b-4484-9ca5-85436f50330c', 'ad3760b8-073e-46f6-9211-a7653f9e80e6'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:38:58 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Delete snapshot completed successfully. Jul 23 22:38:58 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2bec25bd-9afe-478b-a360-2f6adda11649 tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-9fdb5275-7b81-45df-899b-958ad636dfa8-delete_snapshot" released by "delete_snapshot" :: held 1.949s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:38:59 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-487b5345-21d5-497a-8835-5c266879e14f" returned: 0 in 0.276s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.598s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Acquiring lock "cinder-quobyte-6b574844-149b-4fe7-adf7-cfbca6b83158-d36d1ace-3057-4f02-8134-86bf6e9d7d81" by "_create_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ca323f-73d1-403c-ae69-d42a743e9bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487b5345-21d5-497a-8835-5c266879e14f', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507b31d1-21b2-49ed-8229-b160dcb977a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Lock "cinder-quobyte-6b574844-149b-4fe7-adf7-cfbca6b83158-d36d1ace-3057-4f02-8134-86bf6e9d7d81" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Creating volume d36d1ace-3057-4f02-8134-86bf6e9d7d81 from snapshot 6b574844-149b-4fe7-adf7-cfbca6b83158 {{(pid=88308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Acquiring lock "cinder-quobyte-d36d1ace-3057-4f02-8134-86bf6e9d7d81" by "_copy_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "cinder-d3f98d4c-e083-41e1-a628-fad3a53b77a5-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:59 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Volume volume-487b5345-21d5-497a-8835-5c266879e14f (487b5345-21d5-497a-8835-5c266879e14f): created successfully Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507b31d1-21b2-49ed-8229-b160dcb977a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Flow 'volume_create_manager' (1412c0f7-b0a3-4e21-8337-1fd7ef1aecb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Lock "cinder-quobyte-d36d1ace-3057-4f02-8134-86bf6e9d7d81" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] snapshot: 6b574844-149b-4fe7-adf7-cfbca6b83158, volume: d36d1ace-3057-4f02-8134-86bf6e9d7d81, {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-d3f98d4c-e083-41e1-a628-fad3a53b77a5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:59 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b554075f-a717-42bd-88ab-05db5d5a99a0 tempest-ProjectReaderTests-2044125548 None] Created volume successfully. Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[11553cf3-28af-48c7-a0da-8610901b52a8]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "cinder-quobyte-d3f98d4c-e083-41e1-a628-fad3a53b77a5" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-quobyte-d3f98d4c-e083-41e1-a628-fad3a53b77a5" acquired by "delete_volume" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d59f1d-5500-42bb-b4c4-a4c417a26dd2]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:59 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 Jul 23 22:38:59 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:59 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 Jul 23 22:38:59 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:59 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158" returned: 0 in 0.437s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d80a25ef-4f0d-4694-969e-2e469a6de624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Creating direct copy from snapshot {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7603c35-3f93-4abf-96e7-6ba8060b8cbe]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:59 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5" returned: 0 in 0.434s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:38:59 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5 Jul 23 22:38:59 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Flow 'volume_create_manager' (88895ad3-a70a-490d-afe1-2b8fcf4a4a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:38:59 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 Jul 23 22:38:59 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60286ae4-360b-4e89-ae39-baea6128ad38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60286ae4-360b-4e89-ae39-baea6128ad38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-680894213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce3b2a5d-f3ea-4307-9c88-6b1e9e957887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965f72f4ba824aa3b1e48d470854a67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:00Z,use_quota=True,user_id='6b3d179c0e974559a18d6e735ce981d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15d3a9a-4d04-470c-9df0-ed4444e73f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15d3a9a-4d04-470c-9df0-ed4444e73f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6db5981-2b8c-41b2-8ab7-3857bea4926a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6db5981-2b8c-41b2-8ab7-3857bea4926a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce3b2a5d-f3ea-4307-9c88-6b1e9e957887', 'volume_name': 'volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d967f3a9-ef38-4c0a-9eed-7cd90441beab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d967f3a9-ef38-4c0a-9eed-7cd90441beab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbf0292-6090-486f-bdd8-4955220d8c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:38:59 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Volume ce3b2a5d-f3ea-4307-9c88-6b1e9e957887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887', 'volume_size': 1} Jul 23 22:38:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:00 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d3f98d4c-e083-41e1-a628-fad3a53b77a5" returned: 0 in 0.257s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-quobyte-d3f98d4c-e083-41e1-a628-fad3a53b77a5" released by "delete_volume" :: held 0.760s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Created reservations ['db5d4cbf-10b1-4f02-800c-dd0a61c03ddf', '04516105-41e1-4b21-b013-69625dc7fd16', '558958ea-44e3-4691-9aaf-bb6d2d611fb9', '83f6dbab-2265-44a5-a470-c680ba288dd6'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Acquiring lock "cinder-487b5345-21d5-497a-8835-5c266879e14f-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:00 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624" returned: 0 in 0.429s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG cinder.utils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Path /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81 not found in is_blk_device check {{(pid=88308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Lock "cinder-487b5345-21d5-497a-8835-5c266879e14f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:00 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81 Jul 23 22:39:00 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Acquiring lock "cinder-quobyte-487b5345-21d5-497a-8835-5c266879e14f" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Lock "cinder-quobyte-487b5345-21d5-497a-8835-5c266879e14f" acquired by "delete_volume" :: waited 0.050s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:00 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:00 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df79ba5-9821-4f1a-afa3-2a0871adea56]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-487b5345-21d5-497a-8835-5c266879e14f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:00 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-487b5345-21d5-497a-8835-5c266879e14f Jul 23 22:39:00 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:00 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.293s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:00 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Deleted volume successfully. Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a09e099a-27f2-4985-9dd5-ebbc2144138d tempest-CreateVolumesFromSnapshotTest-4572731 None] Lock "cinder-d3f98d4c-e083-41e1-a628-fad3a53b77a5-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:00 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-487b5345-21d5-497a-8835-5c266879e14f" returned: 0 in 0.467s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-487b5345-21d5-497a-8835-5c266879e14f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:00 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-487b5345-21d5-497a-8835-5c266879e14f Jul 23 22:39:00 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:01 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-487b5345-21d5-497a-8835-5c266879e14f" returned: 0 in 0.565s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:01 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Lock "cinder-quobyte-487b5345-21d5-497a-8835-5c266879e14f" released by "delete_volume" :: held 1.128s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:01 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Created reservations ['7381b900-5153-4cb8-ae7a-d30a87f2c9ee', 'fd573bf6-7513-4abc-903c-5030947fc28d', '233ec7f7-5bd0-4f9b-b18e-2ca414997ccd', '82d3d830-84ec-4505-bc6e-8db2fc8c2dfb'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:01 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:01 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:01 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:01 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:02 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.949s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:02 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:02 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Deleted volume successfully. Jul 23 22:39:02 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-371fd111-ada5-4024-8d88-b490dd6cc2e7 tempest-ProjectReaderTests-2044125548 None] Lock "cinder-487b5345-21d5-497a-8835-5c266879e14f-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:03 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:39:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Flow 'volume_create_manager' (f8e215c3-56dd-4159-895a-b728ef79baf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b63694a-aa05-4701-9f58-9e0bffb0f3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b63694a-aa05-4701-9f58-9e0bffb0f3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2026948579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86966ff-721b-485d-83b6-56e63ec27e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b9c8d35cf64104a21ace8e2b5a0866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:04Z,use_quota=True,user_id='b50e3c6539db4468a7fe8b205c1aff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a072ee27-50e3-488a-9e80-ea9471da3685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a072ee27-50e3-488a-9e80-ea9471da3685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd9c940-e167-4957-b9e7-5103d6715e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd9c940-e167-4957-b9e7-5103d6715e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c86966ff-721b-485d-83b6-56e63ec27e6f', 'volume_name': 'volume-c86966ff-721b-485d-83b6-56e63ec27e6f', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6caacb23-9aa7-497b-b52e-df3fc20fa855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6caacb23-9aa7-497b-b52e-df3fc20fa855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c31416-1da1-4b4a-a322-6945715e8f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:04 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Volume c86966ff-721b-485d-83b6-56e63ec27e6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c86966ff-721b-485d-83b6-56e63ec27e6f', 'volume_size': 1} Jul 23 22:39:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:05 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81" returned: 0 in 5.352s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:05 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c617d234-652e-4f7f-ba1e-bb84f1fd70ae]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:05 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 Jul 23 22:39:05 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:06 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624" returned: 0 in 0.541s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81 {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:39:06 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Converted 1024.00 MB image at 191.30 MB/s Jul 23 22:39:06 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81 is being set with open permissions: ugo+rw Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:06 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81 Jul 23 22:39:06 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:06 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81" returned: 0 in 0.257s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Lock "cinder-quobyte-d36d1ace-3057-4f02-8134-86bf6e9d7d81" released by "_copy_volume_from_snapshot" :: held 7.154s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Lock "cinder-quobyte-6b574844-149b-4fe7-adf7-cfbca6b83158-d36d1ace-3057-4f02-8134-86bf6e9d7d81" released by "_create_volume_from_snapshot" :: held 7.227s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.275s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.450s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:38:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-680894213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce3b2a5d-f3ea-4307-9c88-6b1e9e957887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965f72f4ba824aa3b1e48d470854a67c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:00Z,use_quota=True,user_id='6b3d179c0e974559a18d6e735ce981d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Creating volume ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:39:06 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:06 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 1073741824 Jul 23 22:39:06 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (981eb994-371c-4611-9ed4-3bf31c502d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81', 'volume_size': 1, 'snapshot_id': '6b574844-149b-4fe7-adf7-cfbca6b83158'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409b6a35-73d8-4149-80af-01f70efeea0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:06 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Volume volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81 (d36d1ace-3057-4f02-8134-86bf6e9d7d81): created successfully Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409b6a35-73d8-4149-80af-01f70efeea0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Flow 'volume_create_manager' (3c1b4f3f-1671-49e9-a8e9-d9acf47be3ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:06 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-cbfdc3f5-25f8-4862-9d71-fdeecc7e6c62 tempest-VolumeDependencyTests-72732391 None] Created volume successfully. Jul 23 22:39:06 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 1073741824" returned: 0 in 0.457s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:06 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 Jul 23 22:39:06 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Flow 'volume_create_manager' (1f2ea2f9-efac-4c17-b0e4-f50701810825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11385cd-3236-4b27-951b-6d52d0640cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11385cd-3236-4b27-951b-6d52d0640cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1912549144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b11f48-71df-4180-97a8-20dcc4d0ca30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0f3cac148949f1bc1e08b17cd04af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:07Z,use_quota=True,user_id='a75f4208a06541778f1a92aacba752e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4725c47f-06c1-46b9-83b7-e7adc0689b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4725c47f-06c1-46b9-83b7-e7adc0689b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a922647d-8504-4b32-9aa2-0070f847c678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a922647d-8504-4b32-9aa2-0070f847c678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30b11f48-71df-4180-97a8-20dcc4d0ca30', 'volume_name': 'volume-30b11f48-71df-4180-97a8-20dcc4d0ca30', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f64d3f-f259-4363-96ed-3fbdfc79e223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f64d3f-f259-4363-96ed-3fbdfc79e223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b01900-79d3-4d3b-a999-1bb95e78a668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:07 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume 30b11f48-71df-4180-97a8-20dcc4d0ca30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30b11f48-71df-4180-97a8-20dcc4d0ca30', 'volume_size': 1} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:07 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887" returned: 0 in 0.255s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.918s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2026948579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86966ff-721b-485d-83b6-56e63ec27e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b9c8d35cf64104a21ace8e2b5a0866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:04Z,use_quota=True,user_id='b50e3c6539db4468a7fe8b205c1aff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Creating volume c86966ff-721b-485d-83b6-56e63ec27e6f {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:39:07 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c86966ff-721b-485d-83b6-56e63ec27e6f 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Acquiring lock "cinder-6b574844-149b-4fe7-adf7-cfbca6b83158-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:07 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c86966ff-721b-485d-83b6-56e63ec27e6f 1073741824 Jul 23 22:39:07 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbf0292-6090-486f-bdd8-4955220d8c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24545ca-ac0d-4b19-b36a-357809191be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Lock "cinder-6b574844-149b-4fe7-adf7-cfbca6b83158-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Acquiring lock "cinder-quobyte-d80a25ef-4f0d-4694-969e-2e469a6de624" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:07 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Volume volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 (ce3b2a5d-f3ea-4307-9c88-6b1e9e957887): created successfully Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24545ca-ac0d-4b19-b36a-357809191be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Flow 'volume_create_manager' (88895ad3-a70a-490d-afe1-2b8fcf4a4a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Lock "cinder-quobyte-d80a25ef-4f0d-4694-969e-2e469a6de624" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Acquiring lock "cinder-quobyte-6b574844-149b-4fe7-adf7-cfbca6b83158" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:07 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c7909048-ba9b-471c-9123-d6400173669c tempest-CinderUnicodeTest-17891452 None] Created volume successfully. Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Lock "cinder-quobyte-6b574844-149b-4fe7-adf7-cfbca6b83158" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Deleting offline snapshot 6b574844-149b-4fe7-adf7-cfbca6b83158 of volume d80a25ef-4f0d-4694-969e-2e469a6de624 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] snapshot_file for this snap is: volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f985d880-fe29-4e11-bd47-3345d30bed62]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:07 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 Jul 23 22:39:07 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:07 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c86966ff-721b-485d-83b6-56e63ec27e6f 1073741824" returned: 0 in 0.487s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c86966ff-721b-485d-83b6-56e63ec27e6f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:07 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:07 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c86966ff-721b-485d-83b6-56e63ec27e6f Jul 23 22:39:07 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158" returned: 0 in 0.414s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d80a25ef-4f0d-4694-969e-2e469a6de624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28aeeb1-1279-48e1-bc38-64b77e84a00b]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:07 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 Jul 23 22:39:07 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:07 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c86966ff-721b-485d-83b6-56e63ec27e6f" returned: 0 in 0.313s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.892s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1912549144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b11f48-71df-4180-97a8-20dcc4d0ca30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0f3cac148949f1bc1e08b17cd04af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:07Z,use_quota=True,user_id='a75f4208a06541778f1a92aacba752e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Creating volume 30b11f48-71df-4180-97a8-20dcc4d0ca30 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:39:07 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:39:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-30b11f48-71df-4180-97a8-20dcc4d0ca30 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c31416-1da1-4b4a-a322-6945715e8f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c86966ff-721b-485d-83b6-56e63ec27e6f', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:08 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-30b11f48-71df-4180-97a8-20dcc4d0ca30 1073741824 Jul 23 22:39:08 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4c12dc-0926-4772-9588-d1f19bb2462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:08 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Volume volume-c86966ff-721b-485d-83b6-56e63ec27e6f (c86966ff-721b-485d-83b6-56e63ec27e6f): created successfully Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4c12dc-0926-4772-9588-d1f19bb2462f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Flow 'volume_create_manager' (f8e215c3-56dd-4159-895a-b728ef79baf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:08 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-0143bdb5-12b2-412b-9d83-78b3d39e6940 tempest-ProjectReaderTests-2044125548 None] Created volume successfully. Jul 23 22:39:08 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624" returned: 0 in 0.388s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:08 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 Jul 23 22:39:08 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:08 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-30b11f48-71df-4180-97a8-20dcc4d0ca30 1073741824" returned: 0 in 0.434s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-30b11f48-71df-4180-97a8-20dcc4d0ca30 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:08 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158" returned: 0 in 0.369s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:08 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-30b11f48-71df-4180-97a8-20dcc4d0ca30 Jul 23 22:39:08 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:08 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158 Jul 23 22:39:08 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:08 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-30b11f48-71df-4180-97a8-20dcc4d0ca30" returned: 0 in 0.249s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.773s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b01900-79d3-4d3b-a999-1bb95e78a668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b11f48-71df-4180-97a8-20dcc4d0ca30', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:08 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20ece83-0240-4a32-961b-91109831d608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] Creating offline snapshot 7e1117e0-36ce-48fe-92df-563c50f88f4a of volume ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624.6b574844-149b-4fe7-adf7-cfbca6b83158" returned: 0 in 0.264s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:08 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume volume-30b11f48-71df-4180-97a8-20dcc4d0ca30 (30b11f48-71df-4180-97a8-20dcc4d0ca30): created successfully Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b20ece83-0240-4a32-961b-91109831d608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Flow 'volume_create_manager' (1f2ea2f9-efac-4c17-b0e4-f50701810825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4003b8b1-10df-4bba-9b96-59c2b2724379]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Lock "cinder-quobyte-6b574844-149b-4fe7-adf7-cfbca6b83158" released by "_delete_snapshot" :: held 1.564s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:08 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-237b9dab-5a72-418b-b923-4632704321d9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Created volume successfully. Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Lock "cinder-quobyte-d80a25ef-4f0d-4694-969e-2e469a6de624" released by "delete_snapshot" :: held 1.593s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Created reservations ['d34e6f27-d009-46fb-b454-d99e8ca83c33', '1a522408-7ae4-4250-b1b3-c0df27d8106e', 'f2aec882-bd36-407b-b128-b0c9b3cdf9e9', 'd7c088f3-3239-4f75-b1d6-692e52083c87'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:08 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 Jul 23 22:39:08 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:08 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Delete snapshot completed successfully. Jul 23 22:39:08 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-03b949a9-29a6-45bc-bd6b-b52e7b09c52c tempest-VolumeDependencyTests-72732391 None] Lock "cinder-6b574844-149b-4fe7-adf7-cfbca6b83158-delete_snapshot" released by "delete_snapshot" :: held 1.745s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Acquiring lock "cinder-c86966ff-721b-485d-83b6-56e63ec27e6f-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Lock "cinder-c86966ff-721b-485d-83b6-56e63ec27e6f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:09 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887" returned: 0 in 0.423s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Acquiring lock "cinder-quobyte-c86966ff-721b-485d-83b6-56e63ec27e6f" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:09 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a 1G Jul 23 22:39:09 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Lock "cinder-quobyte-c86966ff-721b-485d-83b6-56e63ec27e6f" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c950dd-6ee5-47a4-b52c-9770812afe65]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c86966ff-721b-485d-83b6-56e63ec27e6f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Acquiring lock "cinder-d80a25ef-4f0d-4694-969e-2e469a6de624-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Lock "cinder-d80a25ef-4f0d-4694-969e-2e469a6de624-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Acquiring lock "cinder-quobyte-d80a25ef-4f0d-4694-969e-2e469a6de624" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Lock "cinder-quobyte-d80a25ef-4f0d-4694-969e-2e469a6de624" acquired by "delete_volume" :: waited 0.029s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:09 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c86966ff-721b-485d-83b6-56e63ec27e6f Jul 23 22:39:09 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[723e1724-5ff1-451b-930a-9eb59f2f1c5e]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Flow 'volume_create_manager' (c0502a59-3f60-4307-963b-8d79b27da673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abc336d-a822-4d2e-b015-f9aa57cb3951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:09 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 Jul 23 22:39:09 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abc336d-a822-4d2e-b015-f9aa57cb3951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1255230797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226aee74-f678-45d4-aa7c-7659986b13b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0f3cac148949f1bc1e08b17cd04af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:10Z,use_quota=True,user_id='a75f4208a06541778f1a92aacba752e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b0c4ce-bb17-4565-a460-cf4f24c8183f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b0c4ce-bb17-4565-a460-cf4f24c8183f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227b2b3f-1c1e-46f7-9862-a94fa0f5febb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227b2b3f-1c1e-46f7-9862-a94fa0f5febb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '226aee74-f678-45d4-aa7c-7659986b13b6', 'volume_name': 'volume-226aee74-f678-45d4-aa7c-7659986b13b6', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f040136-e9ea-4915-9365-1e7f0b8f67c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f040136-e9ea-4915-9365-1e7f0b8f67c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18452f7f-00a5-4366-94ad-07baa62a8f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:09 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume 226aee74-f678-45d4-aa7c-7659986b13b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-226aee74-f678-45d4-aa7c-7659986b13b6', 'volume_size': 1} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:09 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c86966ff-721b-485d-83b6-56e63ec27e6f" returned: 0 in 0.583s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c86966ff-721b-485d-83b6-56e63ec27e6f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:09 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a 1G" returned: 0 in 0.704s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:09 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a Jul 23 22:39:09 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:09 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c86966ff-721b-485d-83b6-56e63ec27e6f Jul 23 22:39:09 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Flow 'volume_create_manager' (a0ab8347-4212-4a8a-a1b5-2c28ede3332c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7d179e-5e97-49f2-80c0-d48e939c5df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:10 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624" returned: 0 in 0.608s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7d179e-5e97-49f2-80c0-d48e939c5df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-884549746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf2df29-c11f-46c7-b8d7-a02b8b5eb572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0f3cac148949f1bc1e08b17cd04af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:10Z,use_quota=True,user_id='a75f4208a06541778f1a92aacba752e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3fc5b2-2dd7-41bd-a1a3-016ab4d0e537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:10 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624 Jul 23 22:39:10 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3fc5b2-2dd7-41bd-a1a3-016ab4d0e537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd529467-a57b-4973-844b-662f5c997efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd529467-a57b-4973-844b-662f5c997efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf2df29-c11f-46c7-b8d7-a02b8b5eb572', 'volume_name': 'volume-abf2df29-c11f-46c7-b8d7-a02b8b5eb572', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1276f740-db84-4edd-8588-eb569736d1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1276f740-db84-4edd-8588-eb569736d1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124a522e-e044-40a1-b217-1f14ac37870e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:10 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume abf2df29-c11f-46c7-b8d7-a02b8b5eb572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf2df29-c11f-46c7-b8d7-a02b8b5eb572', 'volume_size': 1} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:10 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-c86966ff-721b-485d-83b6-56e63ec27e6f" returned: 0 in 0.414s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Lock "cinder-quobyte-c86966ff-721b-485d-83b6-56e63ec27e6f" released by "delete_volume" :: held 1.072s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:10 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a" returned: 0 in 0.445s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:10 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a is being set with open permissions: ugo+rw Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:10 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a Jul 23 22:39:10 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Created reservations ['03466239-0fb6-4424-91d5-85cd7211af00', 'cb5a18e0-2d2a-43c6-a44e-2af7de3aa736', '41dd8353-5cfe-402f-8e07-b78d2278a8c3', 'ab9e6bb9-9638-46d1-b0eb-de97996bb093'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:10 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d80a25ef-4f0d-4694-969e-2e469a6de624" returned: 0 in 0.411s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:10 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:10 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Lock "cinder-quobyte-d80a25ef-4f0d-4694-969e-2e469a6de624" released by "delete_volume" :: held 1.136s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Flow 'volume_create_manager' (b497abfd-be98-4ca4-8475-326e80eb4fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dfb54c-e9c1-482b-b2e0-ad1ad23d0e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dfb54c-e9c1-482b-b2e0-ad1ad23d0e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1004943291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be25ad0-cbff-4396-bde0-64bdf514a3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0f3cac148949f1bc1e08b17cd04af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:11Z,use_quota=True,user_id='a75f4208a06541778f1a92aacba752e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa24342f-c4b7-4d4e-b57f-1e9275a59cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:10 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa24342f-c4b7-4d4e-b57f-1e9275a59cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb598f45-ea13-4694-90af-559ceea26b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb598f45-ea13-4694-90af-559ceea26b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be25ad0-cbff-4396-bde0-64bdf514a3c0', 'volume_name': 'volume-1be25ad0-cbff-4396-bde0-64bdf514a3c0', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d184d525-328f-4a5b-a1c0-e1fb41c3d01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d184d525-328f-4a5b-a1c0-e1fb41c3d01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c167986-2013-40dd-9aae-f1fdde734032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:10 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume 1be25ad0-cbff-4396-bde0-64bdf514a3c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be25ad0-cbff-4396-bde0-64bdf514a3c0', 'volume_size': 1} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a" returned: 0 in 0.429s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Created reservations ['6d914215-6693-411a-82ab-7bd64506d581', 'ff6d1253-3187-4c1f-9a31-e428db3893d2', '108d3c1e-f35a-40d1-b930-91ac5f26dc70', 'ddad0919-88fc-41c6-9ba4-9009271e210e'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:10 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.info Jul 23 22:39:10 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:10 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.352s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:10 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Deleted volume successfully. Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-b4ca35e0-545e-4d53-b34f-7308deb52c5d tempest-ProjectReaderTests-2044125548 None] Lock "cinder-c86966ff-721b-485d-83b6-56e63ec27e6f-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Flow 'volume_create_manager' (01d81bc9-db26-441e-aeb7-fabb1ab1afed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695496d0-082d-44dc-8d61-bf6d14aa3337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:11 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:11 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695496d0-082d-44dc-8d61-bf6d14aa3337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1355894914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0ef790-b06e-4486-a3a4-16399750e66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0f3cac148949f1bc1e08b17cd04af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:11Z,use_quota=True,user_id='a75f4208a06541778f1a92aacba752e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5539ca2f-553d-4b8e-afd0-add4fe8987e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5539ca2f-553d-4b8e-afd0-add4fe8987e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b611b4-4e6d-43b6-9ad3-4dde086fe54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b611b4-4e6d-43b6-9ad3-4dde086fe54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae0ef790-b06e-4486-a3a4-16399750e66e', 'volume_name': 'volume-ae0ef790-b06e-4486-a3a4-16399750e66e', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99bf609-7cd4-4cf3-ab52-d27fa68d230c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99bf609-7cd4-4cf3-ab52-d27fa68d230c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e3014f-ee69-43bc-b750-535dd78109ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:11 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume ae0ef790-b06e-4486-a3a4-16399750e66e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae0ef790-b06e-4486-a3a4-16399750e66e', 'volume_size': 1} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:11 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.info" returned: 0 in 0.340s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:11 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.info is being set with open permissions: ugo+rw Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:11 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.info Jul 23 22:39:11 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:11 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.314s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:11 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Deleted volume successfully. Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d657ae99-c68c-4b57-be1c-f0fe78b618f1 tempest-VolumeDependencyTests-72732391 None] Lock "cinder-d80a25ef-4f0d-4694-969e-2e469a6de624-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Flow 'volume_create_manager' (bc37a650-1129-4a52-bc78-fefd4be59b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4822a54c-fb2b-4bcb-853b-875d8576ffed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4822a54c-fb2b-4bcb-853b-875d8576ffed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-389084618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d59a860-66d3-45e0-9f03-97a710dd5714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0f3cac148949f1bc1e08b17cd04af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:11Z,use_quota=True,user_id='a75f4208a06541778f1a92aacba752e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:11 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa9f01e-6d53-4d7e-b476-aa6d8baf8f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa9f01e-6d53-4d7e-b476-aa6d8baf8f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3370cb3-0dc9-4b77-a047-23e66f658a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3370cb3-0dc9-4b77-a047-23e66f658a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d59a860-66d3-45e0-9f03-97a710dd5714', 'volume_name': 'volume-4d59a860-66d3-45e0-9f03-97a710dd5714', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea721540-16b6-4852-9e6e-b9dc2dda09ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea721540-16b6-4852-9e6e-b9dc2dda09ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cccd990-1424-40f5-9cf0-a971f22ff3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:11 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume 4d59a860-66d3-45e0-9f03-97a710dd5714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d59a860-66d3-45e0-9f03-97a710dd5714', 'volume_size': 1} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.info" returned: 0 in 0.326s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.817s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.680s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1255230797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226aee74-f678-45d4-aa7c-7659986b13b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0f3cac148949f1bc1e08b17cd04af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:10Z,use_quota=True,user_id='a75f4208a06541778f1a92aacba752e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Creating volume 226aee74-f678-45d4-aa7c-7659986b13b6 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:39:11 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-226aee74-f678-45d4-aa7c-7659986b13b6 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:11 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-226aee74-f678-45d4-aa7c-7659986b13b6 1073741824 Jul 23 22:39:11 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:11 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2a8bc271-1c49-4334-a612-67d16925ffcb tempest-CinderUnicodeTest-17891452 None] Create snapshot completed successfully Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Acquiring lock "cinder-d36d1ace-3057-4f02-8134-86bf6e9d7d81-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Lock "cinder-d36d1ace-3057-4f02-8134-86bf6e9d7d81-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Acquiring lock "cinder-quobyte-d36d1ace-3057-4f02-8134-86bf6e9d7d81" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Lock "cinder-quobyte-d36d1ace-3057-4f02-8134-86bf6e9d7d81" acquired by "delete_volume" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a13ee1-df33-4af9-bd03-6494bdb21806]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:11 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81 Jul 23 22:39:11 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Flow 'volume_create_manager' (fa1917e6-b383-4fbe-8d24-e75afe7ba4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47340daa-c91e-40c2-b725-3e367bbff020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47340daa-c91e-40c2-b725-3e367bbff020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-351977685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b69236-1b8e-4433-995b-2ec7d66798d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b9c8d35cf64104a21ace8e2b5a0866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:12Z,use_quota=True,user_id='b50e3c6539db4468a7fe8b205c1aff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14464fd1-29e5-4bab-bf17-5731b01d3868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14464fd1-29e5-4bab-bf17-5731b01d3868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b771de-b1ff-45d9-a0dd-f14cf7a20e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b771de-b1ff-45d9-a0dd-f14cf7a20e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b69236-1b8e-4433-995b-2ec7d66798d7', 'volume_name': 'volume-25b69236-1b8e-4433-995b-2ec7d66798d7', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba0c8b9-085b-42b3-8ecc-761ce7de147c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba0c8b9-085b-42b3-8ecc-761ce7de147c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f15d4c8-a983-4921-8d4b-7a4131cd1e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:12 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Volume 25b69236-1b8e-4433-995b-2ec7d66798d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b69236-1b8e-4433-995b-2ec7d66798d7', 'volume_size': 1} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:12 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-226aee74-f678-45d4-aa7c-7659986b13b6 1073741824" returned: 0 in 0.523s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-226aee74-f678-45d4-aa7c-7659986b13b6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:12 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-226aee74-f678-45d4-aa7c-7659986b13b6 Jul 23 22:39:12 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Acquiring lock "cinder-7e1117e0-36ce-48fe-92df-563c50f88f4a-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Lock "cinder-7e1117e0-36ce-48fe-92df-563c50f88f4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Acquiring lock "cinder-quobyte-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Lock "cinder-quobyte-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Acquiring lock "cinder-quobyte-7e1117e0-36ce-48fe-92df-563c50f88f4a" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:12 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81" returned: 0 in 0.442s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Lock "cinder-quobyte-7e1117e0-36ce-48fe-92df-563c50f88f4a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Deleting offline snapshot 7e1117e0-36ce-48fe-92df-563c50f88f4a of volume ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:39:12 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81 Jul 23 22:39:12 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] snapshot_file for this snap is: volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[131e57e0-e99f-4611-bc59-e580526bbcd0]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:12 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-226aee74-f678-45d4-aa7c-7659986b13b6" returned: 0 in 0.285s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:12 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a Jul 23 22:39:12 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.126s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-884549746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf2df29-c11f-46c7-b8d7-a02b8b5eb572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0f3cac148949f1bc1e08b17cd04af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:10Z,use_quota=True,user_id='a75f4208a06541778f1a92aacba752e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Creating volume abf2df29-c11f-46c7-b8d7-a02b8b5eb572 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:39:12 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-abf2df29-c11f-46c7-b8d7-a02b8b5eb572 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18452f7f-00a5-4366-94ad-07baa62a8f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-226aee74-f678-45d4-aa7c-7659986b13b6', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:12 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-abf2df29-c11f-46c7-b8d7-a02b8b5eb572 1073741824 Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88cb370-76f7-42f6-8a60-39773d9b60b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:12 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:12 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume volume-226aee74-f678-45d4-aa7c-7659986b13b6 (226aee74-f678-45d4-aa7c-7659986b13b6): created successfully Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88cb370-76f7-42f6-8a60-39773d9b60b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Flow 'volume_create_manager' (c0502a59-3f60-4307-963b-8d79b27da673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:12 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-12eabc18-f0d5-4dd5-81bd-c1eb26ec5647 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Created volume successfully. Jul 23 22:39:12 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d36d1ace-3057-4f02-8134-86bf6e9d7d81" returned: 0 in 0.285s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Lock "cinder-quobyte-d36d1ace-3057-4f02-8134-86bf6e9d7d81" released by "delete_volume" :: held 0.787s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Created reservations ['0669b0ea-5eda-46ba-968b-177df4738c44', '709268a5-caba-4366-b155-342087a18862', 'd97692ce-cb64-4fc6-9887-f4af8faffe15', 'c056b104-7a21-4b29-babe-efa7a5a89aab'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:12 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a" returned: 0 in 0.452s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:39:12 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:12 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b302fb-5e45-4c88-9425-595cec269e12]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:12 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 Jul 23 22:39:12 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:12 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-abf2df29-c11f-46c7-b8d7-a02b8b5eb572 1073741824" returned: 0 in 0.548s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-abf2df29-c11f-46c7-b8d7-a02b8b5eb572 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:13 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.326s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:13 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Deleted volume successfully. Jul 23 22:39:13 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-abf2df29-c11f-46c7-b8d7-a02b8b5eb572 Jul 23 22:39:13 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2fc96aeb-756e-4040-a569-00bbbc50ec26 tempest-VolumeDependencyTests-72732391 None] Lock "cinder-d36d1ace-3057-4f02-8134-86bf6e9d7d81-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:13 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887" returned: 0 in 0.428s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:13 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a Jul 23 22:39:13 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:13 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-abf2df29-c11f-46c7-b8d7-a02b8b5eb572" returned: 0 in 0.296s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.541s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1004943291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be25ad0-cbff-4396-bde0-64bdf514a3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0f3cac148949f1bc1e08b17cd04af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:11Z,use_quota=True,user_id='a75f4208a06541778f1a92aacba752e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Creating volume 1be25ad0-cbff-4396-bde0-64bdf514a3c0 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:39:13 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1be25ad0-cbff-4396-bde0-64bdf514a3c0 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124a522e-e044-40a1-b217-1f14ac37870e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf2df29-c11f-46c7-b8d7-a02b8b5eb572', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a009ff-db58-48f4-8b71-341b4c31eca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:13 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1be25ad0-cbff-4396-bde0-64bdf514a3c0 1073741824 Jul 23 22:39:13 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:13 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume volume-abf2df29-c11f-46c7-b8d7-a02b8b5eb572 (abf2df29-c11f-46c7-b8d7-a02b8b5eb572): created successfully Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a009ff-db58-48f4-8b71-341b4c31eca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Flow 'volume_create_manager' (a0ab8347-4212-4a8a-a1b5-2c28ede3332c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:13 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f813a264-8b19-45a3-995c-129cfad0677a tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Created volume successfully. Jul 23 22:39:13 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a" returned: 0 in 0.418s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:13 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a Jul 23 22:39:13 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:13 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1be25ad0-cbff-4396-bde0-64bdf514a3c0 1073741824" returned: 0 in 0.530s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1be25ad0-cbff-4396-bde0-64bdf514a3c0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:13 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887.7e1117e0-36ce-48fe-92df-563c50f88f4a" returned: 0 in 0.327s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:13 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1be25ad0-cbff-4396-bde0-64bdf514a3c0 Jul 23 22:39:13 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Lock "cinder-quobyte-7e1117e0-36ce-48fe-92df-563c50f88f4a" released by "_delete_snapshot" :: held 1.739s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:13 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Lock "cinder-quobyte-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887" released by "delete_snapshot" :: held 1.776s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Created reservations ['f516c95f-3eee-4f2d-9346-aed0b652517e', '9bb83243-cc08-4023-9b47-d4f322e9c39d', '64a16ec4-14f4-44ef-91e2-ef1e88bb9f59', '7e601a3c-41f9-4039-8584-f1a3bc6d36d3'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:14 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Delete snapshot completed successfully. Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-035f634b-dbb7-4c2d-b819-2b1655d3615d tempest-CinderUnicodeTest-17891452 None] Lock "cinder-7e1117e0-36ce-48fe-92df-563c50f88f4a-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:14 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1be25ad0-cbff-4396-bde0-64bdf514a3c0" returned: 0 in 0.278s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.090s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1355894914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0ef790-b06e-4486-a3a4-16399750e66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0f3cac148949f1bc1e08b17cd04af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:11Z,use_quota=True,user_id='a75f4208a06541778f1a92aacba752e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Creating volume ae0ef790-b06e-4486-a3a4-16399750e66e {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:39:14 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ae0ef790-b06e-4486-a3a4-16399750e66e 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:14 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ae0ef790-b06e-4486-a3a4-16399750e66e 1073741824 Jul 23 22:39:14 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c167986-2013-40dd-9aae-f1fdde734032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be25ad0-cbff-4396-bde0-64bdf514a3c0', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6167e83-4ef4-46a5-a1c0-a43f600c2d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:14 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume volume-1be25ad0-cbff-4396-bde0-64bdf514a3c0 (1be25ad0-cbff-4396-bde0-64bdf514a3c0): created successfully Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6167e83-4ef4-46a5-a1c0-a43f600c2d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Flow 'volume_create_manager' (b497abfd-be98-4ca4-8475-326e80eb4fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:14 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c8dc6455-1785-40d5-9cc4-fb3ba39f329c tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Created volume successfully. Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Acquiring lock "cinder-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Lock "cinder-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Acquiring lock "cinder-quobyte-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Lock "cinder-quobyte-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887" acquired by "delete_volume" :: waited 0.034s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afaf59e-8493-4e0c-aa2e-3a99f5ec6f23]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:14 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 Jul 23 22:39:14 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:14 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ae0ef790-b06e-4486-a3a4-16399750e66e 1073741824" returned: 0 in 0.641s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ae0ef790-b06e-4486-a3a4-16399750e66e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:14 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ae0ef790-b06e-4486-a3a4-16399750e66e Jul 23 22:39:14 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:15 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887" returned: 0 in 0.495s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:15 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887 Jul 23 22:39:15 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:15 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ae0ef790-b06e-4486-a3a4-16399750e66e" returned: 0 in 0.331s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.720s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-389084618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d59a860-66d3-45e0-9f03-97a710dd5714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da0f3cac148949f1bc1e08b17cd04af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:11Z,use_quota=True,user_id='a75f4208a06541778f1a92aacba752e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Creating volume 4d59a860-66d3-45e0-9f03-97a710dd5714 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:39:15 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4d59a860-66d3-45e0-9f03-97a710dd5714 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e3014f-ee69-43bc-b750-535dd78109ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae0ef790-b06e-4486-a3a4-16399750e66e', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb87aea3-50ac-4ff9-b5c3-18114dd4ad47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:15 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4d59a860-66d3-45e0-9f03-97a710dd5714 1073741824 Jul 23 22:39:15 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:15 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume volume-ae0ef790-b06e-4486-a3a4-16399750e66e (ae0ef790-b06e-4486-a3a4-16399750e66e): created successfully Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb87aea3-50ac-4ff9-b5c3-18114dd4ad47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Flow 'volume_create_manager' (01d81bc9-db26-441e-aeb7-fabb1ab1afed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:15 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a753d5b6-bea3-4ef3-af95-adc7ccf265d2 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Created volume successfully. Jul 23 22:39:15 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887" returned: 0 in 0.308s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Lock "cinder-quobyte-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887" released by "delete_volume" :: held 0.890s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Created reservations ['0bd3e4a8-ea20-4589-ab54-c1fba507554e', 'd9e1c868-e6d4-4a19-aa4e-7e819d56a125', '6d363804-c577-4973-8a9f-101db0af24b2', '973732c2-25c7-4774-9d34-818e07116f3c'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:15 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:15 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Acquiring lock "cinder-2e8ae4e5-d01e-4167-aa97-f354880920e0-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Lock "cinder-2e8ae4e5-d01e-4167-aa97-f354880920e0-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Acquiring lock "cinder-quobyte-2e8ae4e5-d01e-4167-aa97-f354880920e0" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Lock "cinder-quobyte-2e8ae4e5-d01e-4167-aa97-f354880920e0" acquired by "delete_volume" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aa3b5d-e607-4b1a-8b17-b72081ccbd9f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2e8ae4e5-d01e-4167-aa97-f354880920e0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:15 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4d59a860-66d3-45e0-9f03-97a710dd5714 1073741824" returned: 0 in 0.630s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:15 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.383s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:15 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Deleted volume successfully. Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-871dab1c-11d7-4c40-be24-48e2d4425d5e tempest-CinderUnicodeTest-17891452 None] Lock "cinder-ce3b2a5d-f3ea-4307-9c88-6b1e9e957887-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4d59a860-66d3-45e0-9f03-97a710dd5714 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:15 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2e8ae4e5-d01e-4167-aa97-f354880920e0 Jul 23 22:39:15 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:15 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4d59a860-66d3-45e0-9f03-97a710dd5714 Jul 23 22:39:15 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:16 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4d59a860-66d3-45e0-9f03-97a710dd5714" returned: 0 in 0.261s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.175s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-351977685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b69236-1b8e-4433-995b-2ec7d66798d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b9c8d35cf64104a21ace8e2b5a0866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:12Z,use_quota=True,user_id='b50e3c6539db4468a7fe8b205c1aff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Creating volume 25b69236-1b8e-4433-995b-2ec7d66798d7 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:39:16 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-25b69236-1b8e-4433-995b-2ec7d66798d7 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:16 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2e8ae4e5-d01e-4167-aa97-f354880920e0" returned: 0 in 0.443s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2e8ae4e5-d01e-4167-aa97-f354880920e0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:16 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-25b69236-1b8e-4433-995b-2ec7d66798d7 1073741824 Jul 23 22:39:16 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cccd990-1424-40f5-9cf0-a971f22ff3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d59a860-66d3-45e0-9f03-97a710dd5714', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87bbc726-e121-4061-bdb3-6198983585e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:16 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2e8ae4e5-d01e-4167-aa97-f354880920e0 Jul 23 22:39:16 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:16 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Volume volume-4d59a860-66d3-45e0-9f03-97a710dd5714 (4d59a860-66d3-45e0-9f03-97a710dd5714): created successfully Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87bbc726-e121-4061-bdb3-6198983585e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Flow 'volume_create_manager' (bc37a650-1129-4a52-bc78-fefd4be59b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:16 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4b414633-8119-4057-b0db-bd45e7cffea7 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Created volume successfully. Jul 23 22:39:16 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-2e8ae4e5-d01e-4167-aa97-f354880920e0" returned: 0 in 0.279s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Lock "cinder-quobyte-2e8ae4e5-d01e-4167-aa97-f354880920e0" released by "delete_volume" :: held 0.776s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Created reservations ['8dce79d8-1d94-4b9d-914a-9b4aed842a42', '9120ae83-020d-45fa-8428-c47e90b62772', 'a2debe39-decd-44e2-b355-a3ec75b0966a', 'b7da8097-2165-4a54-9ba2-1b569521248c'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:16 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:16 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:16 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-25b69236-1b8e-4433-995b-2ec7d66798d7 1073741824" returned: 0 in 0.571s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-25b69236-1b8e-4433-995b-2ec7d66798d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:16 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-25b69236-1b8e-4433-995b-2ec7d66798d7 Jul 23 22:39:16 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:17 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.311s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:17 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Deleted volume successfully. Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-3bb80359-fc3d-4286-a78c-4a39dab9d23f tempest-CinderUnicodeTest-17891452 None] Lock "cinder-2e8ae4e5-d01e-4167-aa97-f354880920e0-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "cinder-4d59a860-66d3-45e0-9f03-97a710dd5714-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-4d59a860-66d3-45e0-9f03-97a710dd5714-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "cinder-quobyte-4d59a860-66d3-45e0-9f03-97a710dd5714" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-quobyte-4d59a860-66d3-45e0-9f03-97a710dd5714" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d7384c-d068-4a21-9a8b-657ecfac3ea0]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4d59a860-66d3-45e0-9f03-97a710dd5714 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:17 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-25b69236-1b8e-4433-995b-2ec7d66798d7" returned: 0 in 0.461s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f15d4c8-a983-4921-8d4b-7a4131cd1e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b69236-1b8e-4433-995b-2ec7d66798d7', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75481c6a-3e56-4d6c-965b-0c80e762c2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:17 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Volume volume-25b69236-1b8e-4433-995b-2ec7d66798d7 (25b69236-1b8e-4433-995b-2ec7d66798d7): created successfully Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75481c6a-3e56-4d6c-965b-0c80e762c2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Flow 'volume_create_manager' (fa1917e6-b383-4fbe-8d24-e75afe7ba4d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:17 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e3a780c2-80fe-4b7c-8fae-410218599cab tempest-ProjectReaderTests-2044125548 None] Created volume successfully. Jul 23 22:39:17 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4d59a860-66d3-45e0-9f03-97a710dd5714 Jul 23 22:39:17 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:17 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4d59a860-66d3-45e0-9f03-97a710dd5714" returned: 0 in 0.447s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4d59a860-66d3-45e0-9f03-97a710dd5714 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:17 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4d59a860-66d3-45e0-9f03-97a710dd5714 Jul 23 22:39:17 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:18 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4d59a860-66d3-45e0-9f03-97a710dd5714" returned: 0 in 0.280s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-quobyte-4d59a860-66d3-45e0-9f03-97a710dd5714" released by "delete_volume" :: held 0.782s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Created reservations ['b1c0bb72-7c88-480b-b901-b7b97a8969ad', '86a3fdbd-20a5-4b16-b815-ad804b349269', 'c66f05e3-ca21-411c-bcc4-45daf09cf18e', '369f5a12-9206-443d-824a-5fbe1438a76a'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:18 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:18 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "cinder-ae0ef790-b06e-4486-a3a4-16399750e66e-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-ae0ef790-b06e-4486-a3a4-16399750e66e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:18 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.394s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "cinder-quobyte-ae0ef790-b06e-4486-a3a4-16399750e66e" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:18 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Deleted volume successfully. Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-quobyte-ae0ef790-b06e-4486-a3a4-16399750e66e" acquired by "delete_volume" :: waited 0.055s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Acquiring lock "cinder-25b69236-1b8e-4433-995b-2ec7d66798d7-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcf2cff-bab3-46b2-bad2-367f1f0353e2]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ae0ef790-b06e-4486-a3a4-16399750e66e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6078c8ce-4e62-4c67-871c-008f349890c9 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-4d59a860-66d3-45e0-9f03-97a710dd5714-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Lock "cinder-25b69236-1b8e-4433-995b-2ec7d66798d7-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Acquiring lock "cinder-quobyte-25b69236-1b8e-4433-995b-2ec7d66798d7" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Lock "cinder-quobyte-25b69236-1b8e-4433-995b-2ec7d66798d7" acquired by "delete_volume" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[540a6ba5-9720-4fa8-9460-8e9d451b6bb8]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-25b69236-1b8e-4433-995b-2ec7d66798d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:18 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ae0ef790-b06e-4486-a3a4-16399750e66e Jul 23 22:39:18 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:18 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-25b69236-1b8e-4433-995b-2ec7d66798d7 Jul 23 22:39:18 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:19 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ae0ef790-b06e-4486-a3a4-16399750e66e" returned: 0 in 0.535s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ae0ef790-b06e-4486-a3a4-16399750e66e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:19 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-25b69236-1b8e-4433-995b-2ec7d66798d7" returned: 0 in 0.410s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-25b69236-1b8e-4433-995b-2ec7d66798d7 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:19 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ae0ef790-b06e-4486-a3a4-16399750e66e Jul 23 22:39:19 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:19 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-25b69236-1b8e-4433-995b-2ec7d66798d7 Jul 23 22:39:19 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:19 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-ae0ef790-b06e-4486-a3a4-16399750e66e" returned: 0 in 0.344s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:19 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-quobyte-ae0ef790-b06e-4486-a3a4-16399750e66e" released by "delete_volume" :: held 0.974s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-25b69236-1b8e-4433-995b-2ec7d66798d7" returned: 0 in 0.362s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Lock "cinder-quobyte-25b69236-1b8e-4433-995b-2ec7d66798d7" released by "delete_volume" :: held 0.839s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Created reservations ['0130fb3a-e370-4838-8932-00404c1e100e', '09b637f4-3e10-4346-aab0-eacb2ccabdf2', 'b99449ac-0520-4c4f-970c-8eb776515de2', '0abb4594-0e16-4054-a99a-1b930da2a6f8'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Created reservations ['f4c56725-0003-4e58-8cf6-44d559b43b5c', 'a99607ee-ecc5-494f-9eac-15540dce38fa', '6e44d350-2df5-40cf-a045-3cdc2eda1d5a', '522717c3-e700-4ad6-8f83-62204216ac03'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:19 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:19 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:39:19 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:19 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Flow 'volume_create_manager' (c00a752b-adda-474b-8503-d4d0535ac2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:19 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8519017-a3d0-4ee7-ac87-0c9f1bdf0495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8519017-a3d0-4ee7-ac87-0c9f1bdf0495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db843ebd-121c-482d-9374-20ceba6233a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a193471746b342a4845c30be2774bba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:20Z,use_quota=True,user_id='5bda99843b7546fcb1ed3673696bb1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2664681f-f7de-44d2-a0c0-c32dbc9a436a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2664681f-f7de-44d2-a0c0-c32dbc9a436a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34bcf78-362d-4fc9-8f51-200cedf241c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.image.glance [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Creating Keystone auth plugin from conf {{(pid=88308) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 23 22:39:20 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.349s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:20 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Deleted volume successfully. Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1af72bde-ae3b-432e-ba53-847230f5e0ac tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-ae0ef790-b06e-4486-a3a4-16399750e66e-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:20 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.345s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:20 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Deleted volume successfully. Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-01ff88f3-fee5-4637-a86e-dbdd26d7b8f3 tempest-ProjectReaderTests-2044125548 None] Lock "cinder-25b69236-1b8e-4433-995b-2ec7d66798d7-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34bcf78-362d-4fc9-8f51-200cedf241c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db843ebd-121c-482d-9374-20ceba6233a6', 'volume_name': 'volume-db843ebd-121c-482d-9374-20ceba6233a6', 'volume_size': 1, 'image_id': 'ea985ac4-3450-4ed2-baa7-deec795e8018', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea985ac4-3450-4ed2-baa7-deec795e8018', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6de9da27f5b0bc18ca34a172bf71970', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a193471746b342a4845c30be2774bba7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3935107b9f91236aa2f01c52570741907d0953b69ca5b55ed99ac2d3fababf8565d5ed2fb6a29ea564232e51c81a3ac407d65ea46edd04c15958a973d47adacc', 'id': 'ea985ac4-3450-4ed2-baa7-deec795e8018', 'created_at': datetime.datetime(2026, 7, 23, 20, 39, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 39, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea985ac4-3450-4ed2-baa7-deec795e8018/file', 'properties': {}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee89531a-0a24-488c-83ce-31b0ebfbed10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee89531a-0a24-488c-83ce-31b0ebfbed10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38f717b-cc39-4399-9191-aac19a1570e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:20 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Volume db843ebd-121c-482d-9374-20ceba6233a6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db843ebd-121c-482d-9374-20ceba6233a6', 'volume_size': 1, 'image_id': 'ea985ac4-3450-4ed2-baa7-deec795e8018', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea985ac4-3450-4ed2-baa7-deec795e8018', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6de9da27f5b0bc18ca34a172bf71970', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a193471746b342a4845c30be2774bba7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3935107b9f91236aa2f01c52570741907d0953b69ca5b55ed99ac2d3fababf8565d5ed2fb6a29ea564232e51c81a3ac407d65ea46edd04c15958a973d47adacc', 'id': 'ea985ac4-3450-4ed2-baa7-deec795e8018', 'created_at': datetime.datetime(2026, 7, 23, 20, 39, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 39, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea985ac4-3450-4ed2-baa7-deec795e8018/file', 'properties': {}}, 'image_service': } Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Trying to clone db843ebd-121c-482d-9374-20ceba6233a6 from image ea985ac4-3450-4ed2-baa7-deec795e8018 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ea985ac4-3450-4ed2-baa7-deec795e8018', 'metadata': {}}]). {{(pid=88308) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "cinder-1be25ad0-cbff-4396-bde0-64bdf514a3c0-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-1be25ad0-cbff-4396-bde0-64bdf514a3c0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "cinder-quobyte-1be25ad0-cbff-4396-bde0-64bdf514a3c0" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-quobyte-1be25ad0-cbff-4396-bde0-64bdf514a3c0" acquired by "delete_volume" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1267d79-ada2-46cb-bce7-c92d8c970e12]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1be25ad0-cbff-4396-bde0-64bdf514a3c0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 23 22:39:20 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Image download 0.00 MB at 0.00 MB/s Jul 23 22:39:20 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e735fea-fb0a-4fbe-a761-65e6b62f3fdb]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:21 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1be25ad0-cbff-4396-bde0-64bdf514a3c0 Jul 23 22:39:21 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:21 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD Jul 23 22:39:21 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:21 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1be25ad0-cbff-4396-bde0-64bdf514a3c0" returned: 0 in 0.486s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1be25ad0-cbff-4396-bde0-64bdf514a3c0 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:21 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:21 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1be25ad0-cbff-4396-bde0-64bdf514a3c0 Jul 23 22:39:21 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:21 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD Jul 23 22:39:21 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:21 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-1be25ad0-cbff-4396-bde0-64bdf514a3c0" returned: 0 in 0.291s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-quobyte-1be25ad0-cbff-4396-bde0-64bdf514a3c0" released by "delete_volume" :: held 0.848s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Created reservations ['61a9797a-55d7-40c4-9038-c902ceac0c61', '8a0154fc-d48d-4fcd-85b3-2093cf8e5505', '63f4a680-966b-41d3-a366-289a36b6a0ff', '46febd80-e725-4dcf-a77e-93c1bda94dee'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:21 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD" returned: 1 in 0.470s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Temporary image ea985ac4-3450-4ed2-baa7-deec795e8018 is fetched for user 5bda99843b7546fcb1ed3673696bb1d0. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c458ce9-c8b5-4ec8-92d5-d6eb59aee883]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:22 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:22 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "cinder-abf2df29-c11f-46c7-b8d7-a02b8b5eb572-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-abf2df29-c11f-46c7-b8d7-a02b8b5eb572-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "cinder-quobyte-abf2df29-c11f-46c7-b8d7-a02b8b5eb572" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-quobyte-abf2df29-c11f-46c7-b8d7-a02b8b5eb572" acquired by "delete_volume" :: waited 0.030s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:22 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD Jul 23 22:39:22 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec4fae9-6f7c-433b-b889-3cca175f3e82]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-abf2df29-c11f-46c7-b8d7-a02b8b5eb572 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (55001357-2161-4e5d-82e1-61a0b401aa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52796ea2-80b6-4c60-8591-2330f5061e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52796ea2-80b6-4c60-8591-2330f5061e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-801626987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa32fdaf-2718-4fb9-be56-4a997ad80747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:22Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e9c6c8-0a99-4bdb-ada6-a603df125163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:22 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:22 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-abf2df29-c11f-46c7-b8d7-a02b8b5eb572 Jul 23 22:39:22 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e9c6c8-0a99-4bdb-ada6-a603df125163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db206a5e-113d-4805-9157-b24e76206f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db206a5e-113d-4805-9157-b24e76206f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa32fdaf-2718-4fb9-be56-4a997ad80747', 'volume_name': 'volume-fa32fdaf-2718-4fb9-be56-4a997ad80747', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e96f3f6-91c9-4f48-bf0f-3e50c0f97e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e96f3f6-91c9-4f48-bf0f-3e50c0f97e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90be5e4-0e2e-4118-8472-7bc28634f420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:22 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Volume fa32fdaf-2718-4fb9-be56-4a997ad80747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa32fdaf-2718-4fb9-be56-4a997ad80747', 'volume_size': 1} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-801626987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa32fdaf-2718-4fb9-be56-4a997ad80747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:22Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Creating volume fa32fdaf-2718-4fb9-be56-4a997ad80747 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:39:22 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.550s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:22 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Deleted volume successfully. Jul 23 22:39:22 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 1073741824 Jul 23 22:39:22 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-98c5946a-d470-46c4-9c2b-bd510c95c590 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-1be25ad0-cbff-4396-bde0-64bdf514a3c0-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:22 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD" returned: 0 in 0.556s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:22 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD Jul 23 22:39:22 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:22 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-abf2df29-c11f-46c7-b8d7-a02b8b5eb572" returned: 0 in 0.551s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-abf2df29-c11f-46c7-b8d7-a02b8b5eb572 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:22 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-abf2df29-c11f-46c7-b8d7-a02b8b5eb572 Jul 23 22:39:22 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:22 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD" returned: 1 in 0.365s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:22 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 1073741824" returned: 0 in 0.491s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:23 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-abf2df29-c11f-46c7-b8d7-a02b8b5eb572" returned: 0 in 0.273s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:23 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 Jul 23 22:39:23 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-quobyte-abf2df29-c11f-46c7-b8d7-a02b8b5eb572" released by "delete_volume" :: held 0.900s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Created reservations ['891f5894-b125-4675-9054-416eaf3e9939', 'a6965bbd-327d-4ecd-9c69-40b88aa09d7c', '344fd898-7249-4bc9-8043-a6e2a0840993', 'd7517764-54ea-4e54-b2f7-273d4f890265'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:23 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:23 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "cinder-226aee74-f678-45d4-aa7c-7659986b13b6-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:23 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-226aee74-f678-45d4-aa7c-7659986b13b6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747" returned: 0 in 0.271s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.346s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db843ebd-121c-482d-9374-20ceba6233a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a193471746b342a4845c30be2774bba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:20Z,use_quota=True,user_id='5bda99843b7546fcb1ed3673696bb1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Creating volume db843ebd-121c-482d-9374-20ceba6233a6 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:39:23 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:23 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 1073741824 Jul 23 22:39:23 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90be5e4-0e2e-4118-8472-7bc28634f420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa32fdaf-2718-4fb9-be56-4a997ad80747', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3479b5-f528-4889-bbac-afe7c52146b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:23 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Volume volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 (fa32fdaf-2718-4fb9-be56-4a997ad80747): created successfully Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3479b5-f528-4889-bbac-afe7c52146b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (55001357-2161-4e5d-82e1-61a0b401aa4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "cinder-quobyte-226aee74-f678-45d4-aa7c-7659986b13b6" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:23 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-fee5c181-013b-4f7a-9e2e-af92497ebe69 tempest-ProjectMemberTests-1199769787 None] Created volume successfully. Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-quobyte-226aee74-f678-45d4-aa7c-7659986b13b6" acquired by "delete_volume" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f688b04-b81d-4835-809c-e8f25cee09af]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-226aee74-f678-45d4-aa7c-7659986b13b6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:23 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.316s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:23 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Deleted volume successfully. Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-92ac309a-5ff4-4386-8643-9b363e5885ea tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-abf2df29-c11f-46c7-b8d7-a02b8b5eb572-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:23 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-226aee74-f678-45d4-aa7c-7659986b13b6 Jul 23 22:39:23 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:23 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 1073741824" returned: 0 in 0.436s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:23 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 Jul 23 22:39:23 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:23 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-226aee74-f678-45d4-aa7c-7659986b13b6" returned: 0 in 0.404s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-226aee74-f678-45d4-aa7c-7659986b13b6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:23 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-226aee74-f678-45d4-aa7c-7659986b13b6 Jul 23 22:39:23 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:24 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6" returned: 0 in 0.259s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Attempting download of ea985ac4-3450-4ed2-baa7-deec795e8018 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea985ac4-3450-4ed2-baa7-deec795e8018', 'metadata': {}}])) to volume db843ebd-121c-482d-9374-20ceba6233a6. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 23 22:39:24 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c459b2-fcb3-44b6-a03b-619d3e06ec73]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-226aee74-f678-45d4-aa7c-7659986b13b6" returned: 0 in 0.272s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea985ac4-3450-4ed2-baa7-deec795e8018_wz6kypu4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-quobyte-226aee74-f678-45d4-aa7c-7659986b13b6" released by "delete_volume" :: held 0.735s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Created reservations ['fcd2b40e-3973-49be-9858-3937fae4c8f8', '22104dc5-ef54-4df0-a662-20f449507cab', '57978aa0-54c2-441f-aa9b-2d4caac90e82', '7638148e-3fdf-4a6e-8452-7b49e36eb766'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:UPDATE=280,cinder:SELECT=218,cinder:INSERT=73,cinder:DELETE=26 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:39:24 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea985ac4-3450-4ed2-baa7-deec795e8018_wz6kypu4 Jul 23 22:39:24 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:24 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:24 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:24 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ea985ac4-3450-4ed2-baa7-deec795e8018_wz6kypu4" returned: 0 in 0.391s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea985ac4-3450-4ed2-baa7-deec795e8018_wz6kypu4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:24 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.296s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:24 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Deleted volume successfully. Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-1b3da6ce-23cc-40e7-a06d-a030edd2f8aa tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-226aee74-f678-45d4-aa7c-7659986b13b6-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:24 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea985ac4-3450-4ed2-baa7-deec795e8018_wz6kypu4 Jul 23 22:39:24 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "cinder-30b11f48-71df-4180-97a8-20dcc4d0ca30-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-30b11f48-71df-4180-97a8-20dcc4d0ca30-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=214,cinder:UPDATE=331,cinder:INSERT=80,cinder:DELETE=28 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "cinder-quobyte-30b11f48-71df-4180-97a8-20dcc4d0ca30" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] Creating offline snapshot 226e5e03-08be-458e-bb32-5b42810da7ed of volume fa32fdaf-2718-4fb9-be56-4a997ad80747 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-quobyte-30b11f48-71df-4180-97a8-20dcc4d0ca30" acquired by "delete_volume" :: waited 0.025s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[224de9fa-accc-4773-ab6d-1df40a118651]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[390db8cb-78fe-4828-9a0a-aaf07c04b9e1]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-30b11f48-71df-4180-97a8-20dcc4d0ca30 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:24 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea985ac4-3450-4ed2-baa7-deec795e8018_wz6kypu4" returned: 1 in 0.436s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ea985ac4-3450-4ed2-baa7-deec795e8018_wz6kypu4' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f983ba21-d0dd-4efd-b733-1e548e8484ec]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:24 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 Jul 23 22:39:24 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:25 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-30b11f48-71df-4180-97a8-20dcc4d0ca30 Jul 23 22:39:25 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:25 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD Jul 23 22:39:25 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:25 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747" returned: 0 in 0.392s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:25 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-30b11f48-71df-4180-97a8-20dcc4d0ca30" returned: 0 in 0.391s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-30b11f48-71df-4180-97a8-20dcc4d0ca30 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:25 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed 1G Jul 23 22:39:25 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:25 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-30b11f48-71df-4180-97a8-20dcc4d0ca30 Jul 23 22:39:25 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:25 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:25 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD Jul 23 22:39:25 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:25 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-30b11f48-71df-4180-97a8-20dcc4d0ca30" returned: 0 in 0.269s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-quobyte-30b11f48-71df-4180-97a8-20dcc4d0ca30" released by "delete_volume" :: held 0.712s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Created reservations ['a5464c38-efde-4054-9967-96183667d106', 'dd8bfa3d-80a1-4490-8313-9ea1dde8989c', '3f5ff67e-7a1f-491b-bf12-607a75270596', 'a93f2678-f29e-4030-a067-15363e61f882'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:25 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD" returned: 1 in 0.351s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] ea985ac4-3450-4ed2-baa7-deec795e8018 was raw, converting to raw {{(pid=88308) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:25 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed 1G" returned: 0 in 0.439s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:25 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 Jul 23 22:39:25 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:25 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:25 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:25 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:25 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:26 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed" returned: 0 in 0.320s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:26 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed is being set with open permissions: ugo+rw Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:26 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.298s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:26 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Deleted volume successfully. Jul 23 22:39:26 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed Jul 23 22:39:26 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:26 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-07f310ba-5b5a-4371-baa4-b244294c3082 tempest-CreateVolumesFromSourceVolumeTest-941373432 None] Lock "cinder-30b11f48-71df-4180-97a8-20dcc4d0ca30-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6" returned: 0 in 0.423s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ea985ac4-3450-4ed2-baa7-deec795e8018_s5vk73l4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:39:26 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Converted 0.00 MB image at 0.00 MB/s Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:26 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:26 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:26 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 1G Jul 23 22:39:26 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:26 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed" returned: 0 in 0.286s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:26 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:26 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.info Jul 23 22:39:26 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.312s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 29 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:39:26 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 1G" returned: 0 in 0.326s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0176ac-324a-46c6-aa12-f2c233109baf]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:26 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 Jul 23 22:39:26 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:26 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.info" returned: 0 in 0.294s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:26 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.info is being set with open permissions: ugo+rw Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:26 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.info Jul 23 22:39:26 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:26 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6" returned: 0 in 0.414s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:26 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.info" returned: 0 in 0.296s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:27 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 Jul 23 22:39:27 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:27 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c45d0c35-1ed0-4148-896b-304dff25dd33 tempest-ProjectMemberTests-1199769787 None] Create snapshot completed successfully Jul 23 22:39:27 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6" returned: 1 in 0.389s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Downloaded image ea985ac4-3450-4ed2-baa7-deec795e8018 ((None, [{'url': 'file:///opt/stack/data/glance/images/ea985ac4-3450-4ed2-baa7-deec795e8018', 'metadata': {}}])) to volume db843ebd-121c-482d-9374-20ceba6233a6 successfully. {{(pid=88308) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Temporary image ea985ac4-3450-4ed2-baa7-deec795e8018 for user 5bda99843b7546fcb1ed3673696bb1d0 is deleted. {{(pid=88308) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG cinder.volume.volume_utils [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Marking volume db843ebd-121c-482d-9374-20ceba6233a6 as bootable. {{(pid=88308) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Copying metadata from image ea985ac4-3450-4ed2-baa7-deec795e8018 to db843ebd-121c-482d-9374-20ceba6233a6. {{(pid=88308) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Creating volume glance metadata for volume db843ebd-121c-482d-9374-20ceba6233a6 backed by image ea985ac4-3450-4ed2-baa7-deec795e8018 with: {'image_id': 'ea985ac4-3450-4ed2-baa7-deec795e8018', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f6de9da27f5b0bc18ca34a172bf71970', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88308) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38f717b-cc39-4399-9191-aac19a1570e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db843ebd-121c-482d-9374-20ceba6233a6', 'volume_size': 1, 'image_id': 'ea985ac4-3450-4ed2-baa7-deec795e8018', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ea985ac4-3450-4ed2-baa7-deec795e8018', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6de9da27f5b0bc18ca34a172bf71970', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a193471746b342a4845c30be2774bba7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3935107b9f91236aa2f01c52570741907d0953b69ca5b55ed99ac2d3fababf8565d5ed2fb6a29ea564232e51c81a3ac407d65ea46edd04c15958a973d47adacc', 'id': 'ea985ac4-3450-4ed2-baa7-deec795e8018', 'created_at': datetime.datetime(2026, 7, 23, 20, 39, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 23, 20, 39, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ea985ac4-3450-4ed2-baa7-deec795e8018/file', 'properties': {}}, 'image_service': }' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9695d173-2a5b-48a0-86c2-0eb2e7ca0848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:27 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Volume volume-db843ebd-121c-482d-9374-20ceba6233a6 (db843ebd-121c-482d-9374-20ceba6233a6): created successfully Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9695d173-2a5b-48a0-86c2-0eb2e7ca0848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Flow 'volume_create_manager' (c00a752b-adda-474b-8503-d4d0535ac2cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:27 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-304ecb8f-9b60-4c13-8acf-1007680a87b4 tempest-VolumeImageDependencyTests-956869724 None] Created volume successfully. Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-226e5e03-08be-458e-bb32-5b42810da7ed-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-226e5e03-08be-458e-bb32-5b42810da7ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-fa32fdaf-2718-4fb9-be56-4a997ad80747" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-fa32fdaf-2718-4fb9-be56-4a997ad80747" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-226e5e03-08be-458e-bb32-5b42810da7ed" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-226e5e03-08be-458e-bb32-5b42810da7ed" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:27 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Deleting offline snapshot 226e5e03-08be-458e-bb32-5b42810da7ed of volume fa32fdaf-2718-4fb9-be56-4a997ad80747 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:39:28 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] snapshot_file for this snap is: volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:39:28 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb48100-12d7-477f-96d3-2e97bdbcfcff]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:28 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed Jul 23 22:39:28 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:28 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed" returned: 0 in 0.394s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:28 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa32fdaf-2718-4fb9-be56-4a997ad80747(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:39:28 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfe749b-3dcf-47ee-af76-89ccf6dbd70b]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Acquiring lock "cinder-db843ebd-121c-482d-9374-20ceba6233a6-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Lock "cinder-db843ebd-121c-482d-9374-20ceba6233a6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:28 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 Jul 23 22:39:28 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Acquiring lock "cinder-quobyte-db843ebd-121c-482d-9374-20ceba6233a6" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Lock "cinder-quobyte-db843ebd-121c-482d-9374-20ceba6233a6" acquired by "delete_volume" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:28 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cbfa42-733d-401e-a18e-e4dc09ee3545]: (4, 'raw') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:28 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 Jul 23 22:39:28 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:28 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747" returned: 0 in 0.410s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:28 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed Jul 23 22:39:28 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:29 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6" returned: 0 in 0.384s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:29 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 Jul 23 22:39:29 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:29 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed" returned: 0 in 0.410s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:29 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed Jul 23 22:39:29 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:29 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6" returned: 1 in 0.387s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6' failed. Not Retrying. {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:29 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6 Jul 23 22:39:29 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:29 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747.226e5e03-08be-458e-bb32-5b42810da7ed" returned: 0 in 0.282s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-226e5e03-08be-458e-bb32-5b42810da7ed" released by "_delete_snapshot" :: held 1.634s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-fa32fdaf-2718-4fb9-be56-4a997ad80747" released by "delete_snapshot" :: held 1.658s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Created reservations ['340312da-1d9e-4b35-851d-d83b8cbd2ee6', '533b1c46-897d-4a79-8092-66950b8efee0', 'd9f94160-16d7-4184-8e1c-dff92a19c86f', 'b736a1d1-1806-432d-9cf9-47ca6117a406'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:29 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-db843ebd-121c-482d-9374-20ceba6233a6" returned: 0 in 0.308s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Lock "cinder-quobyte-db843ebd-121c-482d-9374-20ceba6233a6" released by "delete_volume" :: held 1.160s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:29 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Delete snapshot completed successfully. Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-52dc304d-3b3b-4ad0-9562-576c5ce64619 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-226e5e03-08be-458e-bb32-5b42810da7ed-delete_snapshot" released by "delete_snapshot" :: held 1.847s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Created reservations ['86a4df28-0e06-4895-87cf-964440f5c60a', 'efce41e9-4da1-4546-8a5a-ef2be96c7429', 'd664e775-d817-41b5-b53f-73a32a26212a', 'c54e422a-e6a0-4497-be35-3f932873e2e4'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:29 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:29 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-fa32fdaf-2718-4fb9-be56-4a997ad80747-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-fa32fdaf-2718-4fb9-be56-4a997ad80747-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-fa32fdaf-2718-4fb9-be56-4a997ad80747" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:30 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-fa32fdaf-2718-4fb9-be56-4a997ad80747" acquired by "delete_volume" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.326s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:30 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:30 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Deleted volume successfully. Jul 23 22:39:30 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce644ab-5223-4c35-8f37-47767545eaac]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6dc4837b-b9be-42a5-afd8-28ccc71b3022 tempest-VolumeImageDependencyTests-956869724 None] Lock "cinder-db843ebd-121c-482d-9374-20ceba6233a6-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:30 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 Jul 23 22:39:30 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:30 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747" returned: 0 in 0.374s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:30 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747 Jul 23 22:39:30 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:30 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-fa32fdaf-2718-4fb9-be56-4a997ad80747" returned: 0 in 0.276s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-fa32fdaf-2718-4fb9-be56-4a997ad80747" released by "delete_volume" :: held 0.731s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:30 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Created reservations ['64aea88c-14d1-4db6-b7ed-fd462f7e3e72', '358ebaa4-5613-4335-a0e0-8dd22b52b65f', '3bd12a7e-f8ae-449f-9034-e2be1013396a', '5bba55dd-d61e-4856-a11a-973fc4d8e49c'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:31 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:31 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:31 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.322s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:31 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Deleted volume successfully. Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-93391bc7-ff8b-4d2d-bba3-87be0b9fe911 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-fa32fdaf-2718-4fb9-be56-4a997ad80747-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (fb3015c9-2d4e-41c3-bd92-d279895ae3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b2376b-300a-4f46-85dc-e04a3c2e3f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b2376b-300a-4f46-85dc-e04a3c2e3f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1071213713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3814be4-527e-4930-b6b9-a88a95354c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:32Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ff6174-f4f7-486e-b473-e75cb697a593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ff6174-f4f7-486e-b473-e75cb697a593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a193b01-086b-4b9e-a0fd-f5b1c9918a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a193b01-086b-4b9e-a0fd-f5b1c9918a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3814be4-527e-4930-b6b9-a88a95354c6b', 'volume_name': 'volume-a3814be4-527e-4930-b6b9-a88a95354c6b', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e43d52-727f-4065-aa61-7ed7f72cb237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e43d52-727f-4065-aa61-7ed7f72cb237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211ac21c-fcfb-4dd5-a305-05d40fbc0a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:31 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Volume a3814be4-527e-4930-b6b9-a88a95354c6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3814be4-527e-4930-b6b9-a88a95354c6b', 'volume_size': 1} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1071213713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3814be4-527e-4930-b6b9-a88a95354c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:32Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Creating volume a3814be4-527e-4930-b6b9-a88a95354c6b {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:39:31 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:39:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:32 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b 1073741824 Jul 23 22:39:32 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:32 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b 1073741824" returned: 0 in 0.541s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:32 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b Jul 23 22:39:32 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:32 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b" returned: 0 in 0.274s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:32 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:39:32 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211ac21c-fcfb-4dd5-a305-05d40fbc0a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3814be4-527e-4930-b6b9-a88a95354c6b', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9047a325-239e-4496-a490-3e82782eb6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:32 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Volume volume-a3814be4-527e-4930-b6b9-a88a95354c6b (a3814be4-527e-4930-b6b9-a88a95354c6b): created successfully Jul 23 22:39:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9047a325-239e-4496-a490-3e82782eb6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:32 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (fb3015c9-2d4e-41c3-bd92-d279895ae3f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:32 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-1ef7ca16-bdaa-4740-b124-d9351e6d3581 tempest-ProjectMemberTests-1199769787 None] Created volume successfully. Jul 23 22:39:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] Creating offline snapshot b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 of volume a3814be4-527e-4930-b6b9-a88a95354c6b {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:39:34 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5a77d4-2b9d-4571-9bf9-18de773049ad]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:34 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b Jul 23 22:39:34 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:34 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b" returned: 0 in 0.403s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:34 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 1G Jul 23 22:39:34 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:35 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 1G" returned: 0 in 0.515s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3814be4-527e-4930-b6b9-a88a95354c6b -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:35 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3814be4-527e-4930-b6b9-a88a95354c6b -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 Jul 23 22:39:35 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:35 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3814be4-527e-4930-b6b9-a88a95354c6b -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36" returned: 0 in 0.335s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:35 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 is being set with open permissions: ugo+rw Jul 23 22:39:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:35 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 Jul 23 22:39:35 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:35 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36" returned: 0 in 0.288s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:35 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.info Jul 23 22:39:35 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:36 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.info" returned: 0 in 0.274s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:36 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.info is being set with open permissions: ugo+rw Jul 23 22:39:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:36 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.info Jul 23 22:39:36 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:36 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.info" returned: 0 in 0.253s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:36 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e997249e-61a5-47c3-9515-2f5e958c3aa5 tempest-ProjectMemberTests-1199769787 None] Create snapshot completed successfully Jul 23 22:39:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-b9fbde7c-8ea6-4507-b554-1ac02c7e0e36-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Lock "cinder-b9fbde7c-8ea6-4507-b554-1ac02c7e0e36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-a3814be4-527e-4930-b6b9-a88a95354c6b" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-a3814be4-527e-4930-b6b9-a88a95354c6b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-b9fbde7c-8ea6-4507-b554-1ac02c7e0e36" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:37 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-b9fbde7c-8ea6-4507-b554-1ac02c7e0e36" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Deleting offline snapshot b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 of volume a3814be4-527e-4930-b6b9-a88a95354c6b {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:39:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] snapshot_file for this snap is: volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:39:37 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc508500-9432-4cc1-a4ab-2298e505f3b3]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:37 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 Jul 23 22:39:37 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:37 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36" returned: 0 in 0.436s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:37 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3814be4-527e-4930-b6b9-a88a95354c6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:39:37 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3bb2e8-fb28-4bda-b269-784296f9edd8]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:38 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b Jul 23 22:39:38 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:38 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b" returned: 0 in 0.361s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:38 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 Jul 23 22:39:38 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:38 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36" returned: 0 in 0.338s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:38 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36 Jul 23 22:39:38 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:38 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b.b9fbde7c-8ea6-4507-b554-1ac02c7e0e36" returned: 0 in 0.244s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-b9fbde7c-8ea6-4507-b554-1ac02c7e0e36" released by "_delete_snapshot" :: held 1.503s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-a3814be4-527e-4930-b6b9-a88a95354c6b" released by "delete_snapshot" :: held 1.537s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:38 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Created reservations ['4a077ca1-f55a-42d7-9535-56288f7d4a88', 'f2599973-8aa0-4715-b882-2bc955a100d7', '3c2024ee-eeeb-4281-aa47-5f1bce221719', 'db083853-bec3-4cbb-82df-9d0b392d7836'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:39 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Delete snapshot completed successfully. Jul 23 22:39:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-de37944f-0c4d-4f99-9bca-46e1403a5f0c tempest-ProjectMemberTests-1199769787 None] Lock "cinder-b9fbde7c-8ea6-4507-b554-1ac02c7e0e36-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-a3814be4-527e-4930-b6b9-a88a95354c6b-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Lock "cinder-a3814be4-527e-4930-b6b9-a88a95354c6b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-a3814be4-527e-4930-b6b9-a88a95354c6b" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-a3814be4-527e-4930-b6b9-a88a95354c6b" acquired by "delete_volume" :: waited 0.030s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:39 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[866c0d91-9b41-4ab7-afe6-3c494faf6e41]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:39 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b Jul 23 22:39:39 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:40 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b" returned: 0 in 0.382s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:40 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b Jul 23 22:39:40 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:40 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-a3814be4-527e-4930-b6b9-a88a95354c6b" returned: 0 in 0.264s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-a3814be4-527e-4930-b6b9-a88a95354c6b" released by "delete_volume" :: held 0.702s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:40 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Created reservations ['a0874ba0-926d-48e1-a6db-ea889703b20d', '8426497f-2d72-41f1-b258-5cc8a21677b2', '8a111736-339d-45a6-a3c0-c593b81b2264', 'fd6f4d01-e09f-407b-a0f2-b9178fee07bc'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:40 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:40 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:40 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.272s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:40 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:40 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Deleted volume successfully. Jul 23 22:39:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-77b7a890-a595-4343-ad69-49169deac0be tempest-ProjectMemberTests-1199769787 None] Lock "cinder-a3814be4-527e-4930-b6b9-a88a95354c6b-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (945f2f13-69b5-4b74-b68c-f65c5d1be931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (102435f7-dce9-4074-bf3e-76c9304c8531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (102435f7-dce9-4074-bf3e-76c9304c8531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-527963886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:41Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd922db0-4b35-4a83-a8a5-af9aed12e0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd922db0-4b35-4a83-a8a5-af9aed12e0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827ca528-98ad-4c65-8cd6-550f4410a1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827ca528-98ad-4c65-8cd6-550f4410a1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd', 'volume_name': 'volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fac584e-894f-4827-a626-2f693b50cbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fac584e-894f-4827-a626-2f693b50cbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5844f81a-5730-4ea8-9b28-bd6d76a61cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:41 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Volume 4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd', 'volume_size': 1} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-527963886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:41Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Creating volume 4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:39:41 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:41 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd 1073741824 Jul 23 22:39:41 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:41 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd 1073741824" returned: 0 in 0.448s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:41 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd Jul 23 22:39:41 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:42 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd" returned: 0 in 0.253s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:39:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5844f81a-5730-4ea8-9b28-bd6d76a61cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89582672-9cb7-4ee0-9a23-31ff5be71700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:42 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Volume volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd (4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd): created successfully Jul 23 22:39:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89582672-9cb7-4ee0-9a23-31ff5be71700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (945f2f13-69b5-4b74-b68c-f65c5d1be931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:42 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-31daf1c2-5215-4946-84b9-de9043406ea4 tempest-ProjectMemberTests-1199769787 None] Created volume successfully. Jul 23 22:39:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] Creating offline snapshot cae19ac5-7061-4c87-9634-fbc299745552 of volume 4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:39:42 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b799336-7c6b-4b5e-b2ee-8370cc8c1b53]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:42 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd Jul 23 22:39:42 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:42 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd" returned: 0 in 0.417s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:42 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552 1G Jul 23 22:39:42 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:43 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552 1G" returned: 0 in 0.381s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:43 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552 Jul 23 22:39:43 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:43 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552" returned: 0 in 0.291s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:43 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552 is being set with open permissions: ugo+rw Jul 23 22:39:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:43 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552 Jul 23 22:39:43 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:43 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552" returned: 0 in 0.241s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:43 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.info Jul 23 22:39:43 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:44 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.info" returned: 0 in 0.251s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:44 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.info is being set with open permissions: ugo+rw Jul 23 22:39:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:44 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.info Jul 23 22:39:44 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:44 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.info" returned: 0 in 0.261s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.923s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:44 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2835ac00-7b7e-42c0-a610-d8efaa358083 tempest-ProjectMemberTests-1199769787 None] Create snapshot completed successfully Jul 23 22:39:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-cae19ac5-7061-4c87-9634-fbc299745552-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-cae19ac5-7061-4c87-9634-fbc299745552-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-cae19ac5-7061-4c87-9634-fbc299745552" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-cae19ac5-7061-4c87-9634-fbc299745552" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Deleting offline snapshot cae19ac5-7061-4c87-9634-fbc299745552 of volume 4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:39:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] snapshot_file for this snap is: volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:39:44 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ef842a-afc0-4de9-8105-ab654f255e72]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:44 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552 Jul 23 22:39:44 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:45 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552" returned: 0 in 0.378s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:39:45 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc8787c-2d0e-42c6-9431-f455d5fbb03c]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:45 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd Jul 23 22:39:45 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:45 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd" returned: 0 in 0.348s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:45 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552 Jul 23 22:39:45 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:45 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552" returned: 0 in 0.332s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:45 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552 Jul 23 22:39:45 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:46 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd.cae19ac5-7061-4c87-9634-fbc299745552" returned: 0 in 0.261s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-cae19ac5-7061-4c87-9634-fbc299745552" released by "_delete_snapshot" :: held 1.424s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd" released by "delete_snapshot" :: held 1.453s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:46 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Created reservations ['12d155d1-6fa5-4f83-b800-45e3b541108b', '52ec5a58-2aef-42d3-867a-13776111fbac', '84acdf49-bade-4483-a171-6fc77e1bfbae', 'e260a356-f128-44e7-93a4-27167a793236'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:46 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Delete snapshot completed successfully. Jul 23 22:39:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-6616b30e-7893-45d5-b8e5-3c7c5bd17683 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-cae19ac5-7061-4c87-9634-fbc299745552-delete_snapshot" released by "delete_snapshot" :: held 1.617s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd" acquired by "delete_volume" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:46 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[262693a4-37a8-4106-a872-9c0b9e5291cf]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:47 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd Jul 23 22:39:47 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:47 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd" returned: 0 in 0.353s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:47 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd Jul 23 22:39:47 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:47 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd" returned: 0 in 0.244s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd" released by "delete_volume" :: held 0.651s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:47 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Created reservations ['bc0db038-6092-4963-92d4-4636180e1e68', '747a773b-4758-46cd-8790-ffbec66d6867', 'c74a6ffb-0dc3-4e91-9059-24cb7787d65b', 'c4c47939-6588-452b-98ba-604e3383466f'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:47 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:47 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:47 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:47 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.254s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:47 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:47 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Deleted volume successfully. Jul 23 22:39:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-416cfbc2-d7d6-468e-b0da-215cacc54c38 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-4ebdd7b1-b299-4001-90e9-5ab12d7ae2bd-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (b275c7e9-16fc-40bb-97d0-35b33c07bc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504e875b-a134-4f51-b42d-253770c1e36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504e875b-a134-4f51-b42d-253770c1e36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-473506724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5991ef7c-2d15-46cd-bc13-6b162159a23b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:48Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90667b2f-02e3-43b6-b591-5ebf4f73df4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90667b2f-02e3-43b6-b591-5ebf4f73df4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed7c365-dd1d-4e9d-bbcd-7c4d0e8082c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed7c365-dd1d-4e9d-bbcd-7c4d0e8082c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5991ef7c-2d15-46cd-bc13-6b162159a23b', 'volume_name': 'volume-5991ef7c-2d15-46cd-bc13-6b162159a23b', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50eef616-109f-4549-a7af-f8ed695beea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50eef616-109f-4549-a7af-f8ed695beea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44631b0-12df-48d5-ac77-efcdf3628934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:48 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Volume 5991ef7c-2d15-46cd-bc13-6b162159a23b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5991ef7c-2d15-46cd-bc13-6b162159a23b', 'volume_size': 1} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-473506724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5991ef7c-2d15-46cd-bc13-6b162159a23b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:48Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Creating volume 5991ef7c-2d15-46cd-bc13-6b162159a23b {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:39:48 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:48 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b 1073741824 Jul 23 22:39:48 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:48 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b 1073741824" returned: 0 in 0.423s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:49 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b Jul 23 22:39:49 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:49 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b" returned: 0 in 0.289s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:39:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44631b0-12df-48d5-ac77-efcdf3628934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5991ef7c-2d15-46cd-bc13-6b162159a23b', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dec32fc-9f1e-4ff4-a370-7cf0a5e87b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:49 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Volume volume-5991ef7c-2d15-46cd-bc13-6b162159a23b (5991ef7c-2d15-46cd-bc13-6b162159a23b): created successfully Jul 23 22:39:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dec32fc-9f1e-4ff4-a370-7cf0a5e87b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (b275c7e9-16fc-40bb-97d0-35b33c07bc0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:49 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-608a2b57-854b-4ca8-a549-4210b50d1dc7 tempest-ProjectMemberTests-1199769787 None] Created volume successfully. Jul 23 22:39:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] Creating offline snapshot 9b63e110-88ea-48e5-a2a6-ed1eff3a4844 of volume 5991ef7c-2d15-46cd-bc13-6b162159a23b {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:39:49 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e18b09f-60aa-42a0-8647-c7ac8d8b006d]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:49 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b Jul 23 22:39:49 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:50 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b" returned: 0 in 0.366s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:50 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844 1G Jul 23 22:39:50 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:50 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844 1G" returned: 0 in 0.415s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5991ef7c-2d15-46cd-bc13-6b162159a23b -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:50 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5991ef7c-2d15-46cd-bc13-6b162159a23b -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844 Jul 23 22:39:50 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:50 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5991ef7c-2d15-46cd-bc13-6b162159a23b -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844" returned: 0 in 0.302s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:50 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844 is being set with open permissions: ugo+rw Jul 23 22:39:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:50 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844 Jul 23 22:39:50 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:51 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844" returned: 0 in 0.254s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:51 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.info Jul 23 22:39:51 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:51 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.info" returned: 0 in 0.279s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:51 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.info is being set with open permissions: ugo+rw Jul 23 22:39:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:51 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.info Jul 23 22:39:51 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:51 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.info" returned: 0 in 0.255s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:51 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-3dd31eb7-c534-4803-9fbb-6091508721e2 tempest-ProjectMemberTests-1199769787 None] Create snapshot completed successfully Jul 23 22:39:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-9b63e110-88ea-48e5-a2a6-ed1eff3a4844-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-9b63e110-88ea-48e5-a2a6-ed1eff3a4844-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-5991ef7c-2d15-46cd-bc13-6b162159a23b" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-5991ef7c-2d15-46cd-bc13-6b162159a23b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-9b63e110-88ea-48e5-a2a6-ed1eff3a4844" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:51 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-9b63e110-88ea-48e5-a2a6-ed1eff3a4844" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:51 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Deleting offline snapshot 9b63e110-88ea-48e5-a2a6-ed1eff3a4844 of volume 5991ef7c-2d15-46cd-bc13-6b162159a23b {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:39:51 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] snapshot_file for this snap is: volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:39:51 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a527138-a531-4d17-96a0-92c70d963e6a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:52 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844 Jul 23 22:39:52 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:52 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844" returned: 0 in 0.367s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5991ef7c-2d15-46cd-bc13-6b162159a23b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:39:52 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4992f4c8-bdb1-45bc-b131-2689fdaa6460]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:52 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b Jul 23 22:39:52 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:52 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b" returned: 0 in 0.394s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:52 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844 Jul 23 22:39:52 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:53 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844" returned: 0 in 0.358s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:53 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844 Jul 23 22:39:53 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:53 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b.9b63e110-88ea-48e5-a2a6-ed1eff3a4844" returned: 0 in 0.258s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-9b63e110-88ea-48e5-a2a6-ed1eff3a4844" released by "_delete_snapshot" :: held 1.471s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-5991ef7c-2d15-46cd-bc13-6b162159a23b" released by "delete_snapshot" :: held 1.497s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:53 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Created reservations ['df1a86f0-ad2d-4c18-b152-e8e568b6d751', '9be4237e-ff24-43c9-b851-d4fe62c8c5d8', 'e6244e06-77af-4bbe-8bc0-7538bffc0ada', '33b03ac6-6b81-4413-9085-0f1dc5ac3488'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:53 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Delete snapshot completed successfully. Jul 23 22:39:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8d69ad8a-b329-45f9-970d-8a616a311a01 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-9b63e110-88ea-48e5-a2a6-ed1eff3a4844-delete_snapshot" released by "delete_snapshot" :: held 1.642s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-5991ef7c-2d15-46cd-bc13-6b162159a23b-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Lock "cinder-5991ef7c-2d15-46cd-bc13-6b162159a23b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-5991ef7c-2d15-46cd-bc13-6b162159a23b" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:39:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-5991ef7c-2d15-46cd-bc13-6b162159a23b" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:39:54 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc77b9bf-92c8-4c59-94d7-3d192dcba453]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:54 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b Jul 23 22:39:54 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:54 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b" returned: 0 in 0.370s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:54 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b Jul 23 22:39:54 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:54 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5991ef7c-2d15-46cd-bc13-6b162159a23b" returned: 0 in 0.252s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-5991ef7c-2d15-46cd-bc13-6b162159a23b" released by "delete_volume" :: held 0.685s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:54 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Created reservations ['d3ebad3d-3a54-4ccf-92f9-aee5668f131f', '16235b67-fe53-4141-be76-13a4d735a1d0', '18de9f25-c56d-49b1-8657-e8a6bdc34c85', '931294af-9897-420b-8238-c85aa147fa48'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:39:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:54 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:39:54 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:55 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.266s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:39:55 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Deleted volume successfully. Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c8f75b9d-0aa2-4ac8-828e-2734e89fb75c tempest-ProjectMemberTests-1199769787 None] Lock "cinder-5991ef7c-2d15-46cd-bc13-6b162159a23b-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (9df7630c-b5c6-4113-934f-2a743b67b518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c133a15a-d019-4f34-b2da-fd0cc014abd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c133a15a-d019-4f34-b2da-fd0cc014abd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1691415491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:56Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3ded2e-d4ac-4c18-88cc-b1e7170e5f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3ded2e-d4ac-4c18-88cc-b1e7170e5f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a712a44-69e3-4c6e-bc6c-d53fac89c52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a712a44-69e3-4c6e-bc6c-d53fac89c52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd38c6ea5-c7ec-4b19-9914-ea9b2ea416a9', 'volume_name': 'volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364d9cf1-b9ab-49ee-ae4a-8d68bbba6d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364d9cf1-b9ab-49ee-ae4a-8d68bbba6d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb82f55-e867-4eac-8ace-b4aeafb575f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:55 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Volume d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9', 'volume_size': 1} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1691415491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:39:56Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Creating volume d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:39:55 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:39:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:55 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 1073741824 Jul 23 22:39:55 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:56 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 1073741824" returned: 0 in 0.465s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:56 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 Jul 23 22:39:56 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:56 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9" returned: 0 in 0.248s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:39:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb82f55-e867-4eac-8ace-b4aeafb575f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b8d9cf-3898-4c13-8bc3-0088c0bcb419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:39:56 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Volume volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 (d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9): created successfully Jul 23 22:39:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b8d9cf-3898-4c13-8bc3-0088c0bcb419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:39:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (9df7630c-b5c6-4113-934f-2a743b67b518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:39:56 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-fd62c6aa-3c2d-4362-a0f4-a6cd201de68d tempest-ProjectMemberTests-1199769787 None] Created volume successfully. Jul 23 22:39:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:39:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:39:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] Creating offline snapshot 3114dd1f-2a37-4ac0-9e5a-bd542a915ddf of volume d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:39:57 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe5c04a-87e3-4c8c-8884-633b01d6c9e2]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:39:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:58 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 Jul 23 22:39:58 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:58 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9" returned: 0 in 0.389s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:58 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf 1G Jul 23 22:39:58 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:58 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf 1G" returned: 0 in 0.440s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:58 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf Jul 23 22:39:58 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:59 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf" returned: 0 in 0.290s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:59 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf is being set with open permissions: ugo+rw Jul 23 22:39:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:59 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf Jul 23 22:39:59 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:59 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf" returned: 0 in 0.245s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:59 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.info Jul 23 22:39:59 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:59 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.info" returned: 0 in 0.252s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:59 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.info is being set with open permissions: ugo+rw Jul 23 22:39:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:39:59 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.info Jul 23 22:39:59 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:39:59 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Jul 23 22:39:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.info" returned: 0 in 0.234s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:39:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.933s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:39:59 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-377b80c1-3308-419f-b193-d7da7963ea61 tempest-ProjectMemberTests-1199769787 None] Create snapshot completed successfully Jul 23 22:39:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-3114dd1f-2a37-4ac0-9e5a-bd542a915ddf-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Lock "cinder-3114dd1f-2a37-4ac0-9e5a-bd542a915ddf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-3114dd1f-2a37-4ac0-9e5a-bd542a915ddf" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-3114dd1f-2a37-4ac0-9e5a-bd542a915ddf" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Deleting offline snapshot 3114dd1f-2a37-4ac0-9e5a-bd542a915ddf of volume d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:40:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] snapshot_file for this snap is: volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:40:00 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9517a195-9273-4e16-be53-672bb655d30a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:00 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf Jul 23 22:40:00 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:00 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf" returned: 0 in 0.348s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:00 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:40:00 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[131aa9e3-d7d0-427f-a5a4-4378eb4a9c58]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:00 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 Jul 23 22:40:00 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:00 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9" returned: 0 in 0.347s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:00 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf Jul 23 22:40:00 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:01 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf" returned: 0 in 0.336s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:01 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf Jul 23 22:40:01 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:01 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9.3114dd1f-2a37-4ac0-9e5a-bd542a915ddf" returned: 0 in 0.266s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:01 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-3114dd1f-2a37-4ac0-9e5a-bd542a915ddf" released by "_delete_snapshot" :: held 1.390s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:01 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9" released by "delete_snapshot" :: held 1.411s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:01 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Created reservations ['297e699c-68a2-4913-b0d5-543d4e6102b0', 'acc7c171-e260-45ef-97f7-b53113e88c93', '49280fcf-0553-4390-8f4c-ec1231006000', '0b2e3f79-ad87-4c7e-b903-187a309f8ba7'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:40:01 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Delete snapshot completed successfully. Jul 23 22:40:01 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2ca53cff-6dc6-41a2-9913-078226a2724f tempest-ProjectMemberTests-1199769787 None] Lock "cinder-3114dd1f-2a37-4ac0-9e5a-bd542a915ddf-delete_snapshot" released by "delete_snapshot" :: held 1.537s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Lock "cinder-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a1dd12-6177-4ac5-aaf1-927f6527e5b3]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:02 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 Jul 23 22:40:02 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:02 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9" returned: 0 in 0.348s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:02 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9 Jul 23 22:40:02 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:02 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9" returned: 0 in 0.249s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9" released by "delete_volume" :: held 0.651s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Created reservations ['42fc2546-47e5-48d4-a83e-3baccee6b538', '629e7372-dc09-40dc-8ecf-6c5dba9039be', 'af43c7ad-263a-485d-a1a2-c5e9bd34c0bb', 'e0e604cc-be13-4d26-bc4f-4ad472bc839d'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:02 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:40:02 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:03 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.242s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:40:03 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Deleted volume successfully. Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-abd7d6ec-746a-4e8b-b419-6584a2d5f49d tempest-ProjectMemberTests-1199769787 None] Lock "cinder-d38c6ea5-c7ec-4b19-9914-ea9b2ea416a9-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (08a3e938-a5dd-49b3-bd2c-468116df6bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e91565c-8774-4439-bb87-6835123d756c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e91565c-8774-4439-bb87-6835123d756c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1221652619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0431176b-2f12-4486-9021-a2c5b69b9b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:40:04Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636b248a-cdea-42fa-b39b-92194332a6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636b248a-cdea-42fa-b39b-92194332a6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4a4181-26a4-4f1b-8a56-0dc5fd3d642b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4a4181-26a4-4f1b-8a56-0dc5fd3d642b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0431176b-2f12-4486-9021-a2c5b69b9b8e', 'volume_name': 'volume-0431176b-2f12-4486-9021-a2c5b69b9b8e', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c0779c-38f2-495f-9e40-7d5bce7b7c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c0779c-38f2-495f-9e40-7d5bce7b7c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecec886-d359-44b3-831d-943a52526132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:03 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Volume 0431176b-2f12-4486-9021-a2c5b69b9b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0431176b-2f12-4486-9021-a2c5b69b9b8e', 'volume_size': 1} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1221652619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0431176b-2f12-4486-9021-a2c5b69b9b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:40:04Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Creating volume 0431176b-2f12-4486-9021-a2c5b69b9b8e {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:40:03 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:40:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:03 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e 1073741824 Jul 23 22:40:03 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:04 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e 1073741824" returned: 0 in 0.404s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:04 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e Jul 23 22:40:04 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:04 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e" returned: 0 in 0.239s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:04 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:40:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecec886-d359-44b3-831d-943a52526132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0431176b-2f12-4486-9021-a2c5b69b9b8e', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c5f37a-a038-4205-bbcd-70116d533cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:04 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Volume volume-0431176b-2f12-4486-9021-a2c5b69b9b8e (0431176b-2f12-4486-9021-a2c5b69b9b8e): created successfully Jul 23 22:40:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c5f37a-a038-4205-bbcd-70116d533cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:04 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (08a3e938-a5dd-49b3-bd2c-468116df6bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:40:04 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-d8d4c237-f868-451d-8ecb-6eb6807cb296 tempest-ProjectMemberTests-1199769787 None] Created volume successfully. Jul 23 22:40:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:04 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] Creating offline snapshot 1c1c5458-d83d-4463-a39e-1fe7830c4286 of volume 0431176b-2f12-4486-9021-a2c5b69b9b8e {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:40:04 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2763a5-0a1e-4990-b6a8-a9880d9c9f6a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:05 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e Jul 23 22:40:05 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:05 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e" returned: 0 in 0.362s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:05 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286 1G Jul 23 22:40:05 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:05 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286 1G" returned: 0 in 0.376s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0431176b-2f12-4486-9021-a2c5b69b9b8e -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:05 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0431176b-2f12-4486-9021-a2c5b69b9b8e -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286 Jul 23 22:40:05 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:05 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0431176b-2f12-4486-9021-a2c5b69b9b8e -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286" returned: 0 in 0.294s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:05 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286 is being set with open permissions: ugo+rw Jul 23 22:40:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:05 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286 Jul 23 22:40:05 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:06 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286" returned: 0 in 0.249s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:06 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.info Jul 23 22:40:06 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:06 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.info" returned: 0 in 0.248s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:06 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.info is being set with open permissions: ugo+rw Jul 23 22:40:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:06 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.info Jul 23 22:40:06 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:06 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.info" returned: 0 in 0.238s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:06 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-bfcc3d72-e541-4fc3-b06e-6645ea90d10e tempest-ProjectMemberTests-1199769787 None] Create snapshot completed successfully Jul 23 22:40:06 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-1c1c5458-d83d-4463-a39e-1fe7830c4286-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Lock "cinder-1c1c5458-d83d-4463-a39e-1fe7830c4286-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-0431176b-2f12-4486-9021-a2c5b69b9b8e" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-0431176b-2f12-4486-9021-a2c5b69b9b8e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-1c1c5458-d83d-4463-a39e-1fe7830c4286" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-1c1c5458-d83d-4463-a39e-1fe7830c4286" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Deleting offline snapshot 1c1c5458-d83d-4463-a39e-1fe7830c4286 of volume 0431176b-2f12-4486-9021-a2c5b69b9b8e {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:40:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] snapshot_file for this snap is: volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:40:07 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c673f389-50a3-430f-9050-deb609e3d9df]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:07 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286 Jul 23 22:40:07 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:07 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286" returned: 0 in 0.357s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:07 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0431176b-2f12-4486-9021-a2c5b69b9b8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:40:07 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e984201-a0e0-46b5-ac81-4dbdf346268a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:07 devstack sudo[108744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e Jul 23 22:40:07 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:07 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e" returned: 0 in 0.349s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:07 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286 Jul 23 22:40:07 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:08 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286" returned: 0 in 0.337s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:08 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286 Jul 23 22:40:08 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:08 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e.1c1c5458-d83d-4463-a39e-1fe7830c4286" returned: 0 in 0.269s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:08 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-1c1c5458-d83d-4463-a39e-1fe7830c4286" released by "_delete_snapshot" :: held 1.398s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:08 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-0431176b-2f12-4486-9021-a2c5b69b9b8e" released by "delete_snapshot" :: held 1.418s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:08 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Created reservations ['11c4ff20-14f4-4b21-a831-518b2b5cc288', '4a636f83-ea34-40cb-ab0b-c2206e2d27e9', 'be0d179a-157d-4c68-8241-553ff39458ca', '30a47e43-cfd3-413a-8ed0-064ea85694ae'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:40:08 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Delete snapshot completed successfully. Jul 23 22:40:08 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-dac0ceb9-1688-455a-9b79-dd2fa659422f tempest-ProjectMemberTests-1199769787 None] Lock "cinder-1c1c5458-d83d-4463-a39e-1fe7830c4286-delete_snapshot" released by "delete_snapshot" :: held 1.540s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-0431176b-2f12-4486-9021-a2c5b69b9b8e-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Lock "cinder-0431176b-2f12-4486-9021-a2c5b69b9b8e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-0431176b-2f12-4486-9021-a2c5b69b9b8e" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-0431176b-2f12-4486-9021-a2c5b69b9b8e" acquired by "delete_volume" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[959fb236-644b-43b6-87b8-20a498f87e10]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:09 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e Jul 23 22:40:09 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:09 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e" returned: 0 in 0.357s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:09 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e Jul 23 22:40:09 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:09 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-0431176b-2f12-4486-9021-a2c5b69b9b8e" returned: 0 in 0.244s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-0431176b-2f12-4486-9021-a2c5b69b9b8e" released by "delete_volume" :: held 0.653s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Created reservations ['405aa45b-0c63-4b96-97b7-3147f15e7f85', 'c471a9f6-f0b2-411d-a129-01ef4aa1aa53', '38c12dfc-c1bc-4f88-8f67-965d02e68c0e', 'e5253ccb-2e83-4492-a1f3-3779b4301f97'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:09 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:40:09 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:10 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.244s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:40:10 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Deleted volume successfully. Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-935540ff-20ce-42a4-ad16-f3a6c44a3f4b tempest-ProjectMemberTests-1199769787 None] Lock "cinder-0431176b-2f12-4486-9021-a2c5b69b9b8e-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (32f47159-79fd-4284-9ca0-6d1858326cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed10d68e-3d63-488d-bc61-fe819a4f36c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed10d68e-3d63-488d-bc61-fe819a4f36c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189060041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe83a54-745e-4e61-9b2f-1f11d193a65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:40:11Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77f393f-6645-463d-8689-deeb1891b8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77f393f-6645-463d-8689-deeb1891b8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778debfc-d73c-47ea-bebd-2f95b4713166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778debfc-d73c-47ea-bebd-2f95b4713166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe83a54-745e-4e61-9b2f-1f11d193a65e', 'volume_name': 'volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57836f9-2285-410f-9abe-070b294e8a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57836f9-2285-410f-9abe-070b294e8a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab2b904-055d-4b97-b2f2-590127c1ee01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:10 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Volume 5fe83a54-745e-4e61-9b2f-1f11d193a65e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e', 'volume_size': 1} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189060041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe83a54-745e-4e61-9b2f-1f11d193a65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:40:11Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Creating volume 5fe83a54-745e-4e61-9b2f-1f11d193a65e {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:40:10 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:40:10 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:10 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e 1073741824 Jul 23 22:40:10 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:11 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e 1073741824" returned: 0 in 0.419s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:11 devstack sudo[108775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e Jul 23 22:40:11 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:11 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e" returned: 0 in 0.259s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:40:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab2b904-055d-4b97-b2f2-590127c1ee01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e078020-156e-4500-812b-a9126c56fffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:11 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Volume volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e (5fe83a54-745e-4e61-9b2f-1f11d193a65e): created successfully Jul 23 22:40:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e078020-156e-4500-812b-a9126c56fffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:11 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (32f47159-79fd-4284-9ca0-6d1858326cb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:40:11 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-8ec18629-7ff7-4e74-afe9-4a68de44a256 tempest-ProjectMemberTests-1199769787 None] Created volume successfully. Jul 23 22:40:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:11 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] Creating offline snapshot 6bd07360-c663-4167-9520-f943c62d18ed of volume 5fe83a54-745e-4e61-9b2f-1f11d193a65e {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:40:11 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1632dfba-7946-4ece-9eae-5343f5df378c]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:11 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:12 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e Jul 23 22:40:12 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:12 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e" returned: 0 in 0.353s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:12 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed 1G Jul 23 22:40:12 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:12 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed 1G" returned: 0 in 0.378s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:12 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed Jul 23 22:40:12 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:12 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed" returned: 0 in 0.281s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:12 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed is being set with open permissions: ugo+rw Jul 23 22:40:12 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:12 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed Jul 23 22:40:12 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:13 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed" returned: 0 in 0.238s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:13 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.info Jul 23 22:40:13 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:13 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.info" returned: 0 in 0.261s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:13 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.info is being set with open permissions: ugo+rw Jul 23 22:40:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:13 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.info Jul 23 22:40:13 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:13 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.info" returned: 0 in 0.243s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.826s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:13 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-b3137022-0e1b-4e70-88cb-99f14b0d5dc4 tempest-ProjectMemberTests-1199769787 None] Create snapshot completed successfully Jul 23 22:40:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-6bd07360-c663-4167-9520-f943c62d18ed-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-6bd07360-c663-4167-9520-f943c62d18ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-5fe83a54-745e-4e61-9b2f-1f11d193a65e" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-5fe83a54-745e-4e61-9b2f-1f11d193a65e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-6bd07360-c663-4167-9520-f943c62d18ed" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-6bd07360-c663-4167-9520-f943c62d18ed" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:14 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Deleting offline snapshot 6bd07360-c663-4167-9520-f943c62d18ed of volume 5fe83a54-745e-4e61-9b2f-1f11d193a65e {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:40:14 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] snapshot_file for this snap is: volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:40:14 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3226e312-7fa6-456b-844d-608a6fd261ee]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:14 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed Jul 23 22:40:14 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:14 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed" returned: 0 in 0.365s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:14 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:40:14 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55b43c3-43d4-42e2-920a-f449d91f8173]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:14 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e Jul 23 22:40:14 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:14 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e" returned: 0 in 0.356s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:14 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed Jul 23 22:40:14 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:15 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed" returned: 0 in 0.345s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:15 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed Jul 23 22:40:15 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:15 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e.6bd07360-c663-4167-9520-f943c62d18ed" returned: 0 in 0.237s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-6bd07360-c663-4167-9520-f943c62d18ed" released by "_delete_snapshot" :: held 1.392s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-5fe83a54-745e-4e61-9b2f-1f11d193a65e" released by "delete_snapshot" :: held 1.414s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:15 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Created reservations ['b769d715-3c7a-49c0-8749-0420878ad047', 'aecd7803-4581-42c6-8627-bccd979b6319', 'b2139e68-6f93-4c6e-ae89-830ce5ebbd02', 'f3ee0d35-7ede-4d6b-8cda-f5913242fb20'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:40:15 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Delete snapshot completed successfully. Jul 23 22:40:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-f56fbfe6-b18f-49e9-b7f6-c7710d8dc7a4 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-6bd07360-c663-4167-9520-f943c62d18ed-delete_snapshot" released by "delete_snapshot" :: held 1.555s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-5fe83a54-745e-4e61-9b2f-1f11d193a65e-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Lock "cinder-5fe83a54-745e-4e61-9b2f-1f11d193a65e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-5fe83a54-745e-4e61-9b2f-1f11d193a65e" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-5fe83a54-745e-4e61-9b2f-1f11d193a65e" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b5c77a-0b35-48ac-b2a4-80168288fa50]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:16 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e Jul 23 22:40:16 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:16 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e" returned: 0 in 0.358s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:16 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e Jul 23 22:40:16 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:16 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-5fe83a54-745e-4e61-9b2f-1f11d193a65e" returned: 0 in 0.246s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-5fe83a54-745e-4e61-9b2f-1f11d193a65e" released by "delete_volume" :: held 0.662s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Created reservations ['cf6172b7-5ce6-442f-8d76-66b0acf292a4', 'bf4fc81a-a116-42e6-861a-cf9fab574024', '3c67af86-b23f-4827-b6a7-845eb749d07b', '8ad7e0d6-e9e3-4d7c-adef-c3b400ece198'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:17 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:40:17 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:17 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.256s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:40:17 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Deleted volume successfully. Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2e09c3df-4844-4b16-a456-6c49a26ad5eb tempest-ProjectMemberTests-1199769787 None] Lock "cinder-5fe83a54-745e-4e61-9b2f-1f11d193a65e-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (2232f38c-3fb8-48ec-a6f5-4a3876e54f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829b5bf5-cde4-47c0-b928-45b5e7e622f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829b5bf5-cde4-47c0-b928-45b5e7e622f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-58516247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ca2f6a-6301-4216-80b1-7959e0f6fba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:40:18Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11488646-928e-44fa-9026-086d5fd0a3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11488646-928e-44fa-9026-086d5fd0a3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad09d234-37fe-4776-88bc-3c8e9f541a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad09d234-37fe-4776-88bc-3c8e9f541a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9ca2f6a-6301-4216-80b1-7959e0f6fba8', 'volume_name': 'volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b62068-3ccb-4721-9d76-7b6d9cf0b491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b62068-3ccb-4721-9d76-7b6d9cf0b491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffeaab74-f529-4575-8f0f-9220907eb58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:17 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Volume d9ca2f6a-6301-4216-80b1-7959e0f6fba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8', 'volume_size': 1} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-58516247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ca2f6a-6301-4216-80b1-7959e0f6fba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:40:18Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Creating volume d9ca2f6a-6301-4216-80b1-7959e0f6fba8 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:40:17 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:40:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:17 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 1073741824 Jul 23 22:40:17 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:18 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 1073741824" returned: 0 in 0.403s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:18 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 Jul 23 22:40:18 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:18 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8" returned: 0 in 0.235s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:40:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffeaab74-f529-4575-8f0f-9220907eb58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5780cd-92e4-46f2-978d-a04f735678ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:18 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Volume volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 (d9ca2f6a-6301-4216-80b1-7959e0f6fba8): created successfully Jul 23 22:40:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5780cd-92e4-46f2-978d-a04f735678ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:18 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (2232f38c-3fb8-48ec-a6f5-4a3876e54f79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:40:18 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-38fcdde8-bfa8-4864-83f5-efc830510f36 tempest-ProjectMemberTests-1199769787 None] Created volume successfully. Jul 23 22:40:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:18 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] Creating offline snapshot 0c02dcec-5a7a-4e96-a3c2-2920a0f88392 of volume d9ca2f6a-6301-4216-80b1-7959e0f6fba8 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:40:18 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5884a0-34a3-43ad-bf62-606b52f96f1e]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:18 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:19 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 Jul 23 22:40:19 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:19 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8" returned: 0 in 0.349s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:19 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392 1G Jul 23 22:40:19 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:19 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392 1G" returned: 0 in 0.383s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:19 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392 Jul 23 22:40:19 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:19 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392" returned: 0 in 0.297s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:19 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392 is being set with open permissions: ugo+rw Jul 23 22:40:19 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:20 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392 Jul 23 22:40:20 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:20 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392" returned: 0 in 0.239s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:20 devstack sudo[108900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.info Jul 23 22:40:20 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:20 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.info" returned: 0 in 0.240s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:20 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.info is being set with open permissions: ugo+rw Jul 23 22:40:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:20 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.info Jul 23 22:40:20 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:20 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.info" returned: 0 in 0.239s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:20 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.823s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:20 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-13abcc97-543d-488e-ad32-1f5b63870f96 tempest-ProjectMemberTests-1199769787 None] Create snapshot completed successfully Jul 23 22:40:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-0c02dcec-5a7a-4e96-a3c2-2920a0f88392-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-0c02dcec-5a7a-4e96-a3c2-2920a0f88392-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-d9ca2f6a-6301-4216-80b1-7959e0f6fba8" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-d9ca2f6a-6301-4216-80b1-7959e0f6fba8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-0c02dcec-5a7a-4e96-a3c2-2920a0f88392" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:21 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-0c02dcec-5a7a-4e96-a3c2-2920a0f88392" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Deleting offline snapshot 0c02dcec-5a7a-4e96-a3c2-2920a0f88392 of volume d9ca2f6a-6301-4216-80b1-7959e0f6fba8 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:40:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] snapshot_file for this snap is: volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:40:21 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1313e8c4-4e95-4048-850a-48b43637649f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:21 devstack sudo[108906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392 Jul 23 22:40:21 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:21 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392" returned: 0 in 0.345s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:21 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:40:21 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd45a993-2467-4de1-ae4c-c193715dbece]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:21 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 Jul 23 22:40:21 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:21 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8" returned: 0 in 0.347s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:21 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:21 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392 Jul 23 22:40:21 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:22 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392" returned: 0 in 0.343s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:22 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392 Jul 23 22:40:22 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:22 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:22 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8.0c02dcec-5a7a-4e96-a3c2-2920a0f88392" returned: 0 in 0.240s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-0c02dcec-5a7a-4e96-a3c2-2920a0f88392" released by "_delete_snapshot" :: held 1.365s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-d9ca2f6a-6301-4216-80b1-7959e0f6fba8" released by "delete_snapshot" :: held 1.387s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:22 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Created reservations ['b7dd1a5f-5ed7-4895-bbd7-40b3a1eed3d7', '7faf423d-f7af-4f7a-8f61-eb8b5fbe1cc5', 'e85de5c1-0fef-4d0e-aaa4-edd02242de49', 'cc08f9f8-9742-46ae-838d-3917e079b609'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:40:22 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Delete snapshot completed successfully. Jul 23 22:40:22 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-5b002432-4c98-4570-a2cc-745bc49b6880 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-0c02dcec-5a7a-4e96-a3c2-2920a0f88392-delete_snapshot" released by "delete_snapshot" :: held 1.515s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-d9ca2f6a-6301-4216-80b1-7959e0f6fba8-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-d9ca2f6a-6301-4216-80b1-7959e0f6fba8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-d9ca2f6a-6301-4216-80b1-7959e0f6fba8" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-d9ca2f6a-6301-4216-80b1-7959e0f6fba8" acquired by "delete_volume" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:23 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa4e4e9-34f0-4726-9969-c9e04052ac7f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:23 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 Jul 23 22:40:23 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:23 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8" returned: 0 in 0.349s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:23 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8 Jul 23 22:40:23 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:23 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:23 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-d9ca2f6a-6301-4216-80b1-7959e0f6fba8" returned: 0 in 0.239s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:23 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-d9ca2f6a-6301-4216-80b1-7959e0f6fba8" released by "delete_volume" :: held 0.646s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:23 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Created reservations ['efb8875d-1e50-4218-a49a-8616b0939f47', 'dd90d794-c8fd-4c14-b790-be48f75b594f', '18b3576d-9d60-4002-be18-008645d2f236', 'a2a1639f-03f5-46b4-891b-de2746d67199'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:24 devstack sudo[108938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:40:24 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:24 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.245s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:40:24 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Deleted volume successfully. Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-fed007ef-9bfc-4fb6-bf94-6c583fac8cb1 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-d9ca2f6a-6301-4216-80b1-7959e0f6fba8-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:UPDATE=154,cinder:DELETE=13,cinder:SELECT=134,cinder:INSERT=44 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (14dba432-9599-4970-99f2-ef53d2f46ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8335ae-ceef-4e36-a25c-540549ec33ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8335ae-ceef-4e36-a25c-540549ec33ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-499300104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501b9bda-9290-4b0f-a9ef-9e426caff9f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:40:25Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e3b523-9a6a-4b60-87cf-7b04b866e65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e3b523-9a6a-4b60-87cf-7b04b866e65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a49d2a7-6751-4e75-afef-c990d0fa02d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a49d2a7-6751-4e75-afef-c990d0fa02d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '501b9bda-9290-4b0f-a9ef-9e426caff9f3', 'volume_name': 'volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3582ffe7-df09-43fd-8906-4d5ba25baa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3582ffe7-df09-43fd-8906-4d5ba25baa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19810997-0590-4f64-a105-4ce47dbc4cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:24 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Volume 501b9bda-9290-4b0f-a9ef-9e426caff9f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3', 'volume_size': 1} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-499300104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501b9bda-9290-4b0f-a9ef-9e426caff9f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f3668ddb5245b8af7708d9c20d33ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:40:25Z,use_quota=True,user_id='3ed5d8e71cfa47469ec940b5b1b11b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Creating volume 501b9bda-9290-4b0f-a9ef-9e426caff9f3 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:40:24 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:40:24 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:24 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 1073741824 Jul 23 22:40:24 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:25 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 1073741824" returned: 0 in 0.404s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:25 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=124,cinder:INSERT=51,cinder:UPDATE=165,cinder:DELETE=14 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:40:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:25 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 Jul 23 22:40:25 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:25 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3" returned: 0 in 0.236s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:40:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19810997-0590-4f64-a105-4ce47dbc4cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4dbe80-6e4c-4561-a85b-f9601874cbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:25 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Volume volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 (501b9bda-9290-4b0f-a9ef-9e426caff9f3): created successfully Jul 23 22:40:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4dbe80-6e4c-4561-a85b-f9601874cbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:25 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Flow 'volume_create_manager' (14dba432-9599-4970-99f2-ef53d2f46ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:40:25 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-61eac636-5f14-4520-ad8a-4de5e3cb4110 tempest-ProjectMemberTests-1199769787 None] Created volume successfully. Jul 23 22:40:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:25 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] Creating offline snapshot 814aee14-fe86-4c6a-9f11-70d1e6dda44c of volume 501b9bda-9290-4b0f-a9ef-9e426caff9f3 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:40:25 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b272d02-dd30-415d-a4aa-09409c093654]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:25 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:40:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:26 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 Jul 23 22:40:26 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:26 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:40:26 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:26 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.255s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:40:26 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3" returned: 0 in 0.361s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:40:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 29 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:40:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:40:26 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c 1G Jul 23 22:40:26 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:26 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c 1G" returned: 0 in 0.396s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:26 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c Jul 23 22:40:26 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:27 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c" returned: 0 in 0.280s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:27 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c is being set with open permissions: ugo+rw Jul 23 22:40:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:27 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c Jul 23 22:40:27 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:27 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c" returned: 0 in 0.238s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:27 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.info Jul 23 22:40:27 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:27 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.info" returned: 0 in 0.242s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:27 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.info is being set with open permissions: ugo+rw Jul 23 22:40:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:27 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.info Jul 23 22:40:27 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:27 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.info" returned: 0 in 0.239s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:27 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.829s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:27 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-bad8e5e4-380f-4510-9b27-e6c2adff7ad3 tempest-ProjectMemberTests-1199769787 None] Create snapshot completed successfully Jul 23 22:40:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-814aee14-fe86-4c6a-9f11-70d1e6dda44c-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-814aee14-fe86-4c6a-9f11-70d1e6dda44c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-501b9bda-9290-4b0f-a9ef-9e426caff9f3" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-501b9bda-9290-4b0f-a9ef-9e426caff9f3" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-814aee14-fe86-4c6a-9f11-70d1e6dda44c" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:28 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-814aee14-fe86-4c6a-9f11-70d1e6dda44c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:28 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Deleting offline snapshot 814aee14-fe86-4c6a-9f11-70d1e6dda44c of volume 501b9bda-9290-4b0f-a9ef-9e426caff9f3 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:40:28 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] snapshot_file for this snap is: volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:40:28 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d530c156-2004-4eb7-8f37-ae946c22b8f1]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:28 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c Jul 23 22:40:28 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:28 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c" returned: 0 in 0.355s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:28 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:40:28 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e170723-d1cb-4528-9baf-23e4bfd60895]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:28 devstack sudo[108983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 Jul 23 22:40:28 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:28 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3" returned: 0 in 0.344s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:28 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:29 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c Jul 23 22:40:29 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:29 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c" returned: 0 in 0.334s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:29 devstack sudo[108994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c Jul 23 22:40:29 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:29 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:29 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3.814aee14-fe86-4c6a-9f11-70d1e6dda44c" returned: 0 in 0.247s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-814aee14-fe86-4c6a-9f11-70d1e6dda44c" released by "_delete_snapshot" :: held 1.373s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-501b9bda-9290-4b0f-a9ef-9e426caff9f3" released by "delete_snapshot" :: held 1.397s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:29 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Created reservations ['e0bcf6cc-5d1a-43c8-bac6-22ceb2c51435', 'c0eb70b7-8625-42ac-8372-f604761f6736', '0b192d7a-4ee1-4b35-a50d-cf7c206addd2', '071c418c-d9cf-4805-a53c-8ae4e33861fd'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:40:29 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Delete snapshot completed successfully. Jul 23 22:40:29 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-7e593140-a22c-4e07-8038-a4dd3be5a9f6 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-814aee14-fe86-4c6a-9f11-70d1e6dda44c-delete_snapshot" released by "delete_snapshot" :: held 1.525s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-501b9bda-9290-4b0f-a9ef-9e426caff9f3-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-501b9bda-9290-4b0f-a9ef-9e426caff9f3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "cinder-quobyte-501b9bda-9290-4b0f-a9ef-9e426caff9f3" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:30 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-501b9bda-9290-4b0f-a9ef-9e426caff9f3" acquired by "delete_volume" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:30 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a3aa13-bf60-40b3-b0ee-a107f71145a0]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:30 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 Jul 23 22:40:30 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:30 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3" returned: 0 in 0.357s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:30 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:30 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3 Jul 23 22:40:30 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:31 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-501b9bda-9290-4b0f-a9ef-9e426caff9f3" returned: 0 in 0.244s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-quobyte-501b9bda-9290-4b0f-a9ef-9e426caff9f3" released by "delete_volume" :: held 0.656s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:31 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Created reservations ['dc48bc48-9196-463e-babf-5235dc5d8891', 'cde58baa-248f-4411-8b04-54753035cf29', '6315f913-b311-4d4b-bdd9-b3a46cace279', '6df8c806-6a86-412c-9337-69ba7dca831f'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:40:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:31 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:31 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:40:31 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:31 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:31 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.233s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:31 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:40:31 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Deleted volume successfully. Jul 23 22:40:31 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-e7246ced-b1e0-48b5-93fe-dc48f027cb52 tempest-ProjectMemberTests-1199769787 None] Lock "cinder-501b9bda-9290-4b0f-a9ef-9e426caff9f3-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Flow 'volume_create_manager' (70eb8cf0-18de-4dc0-b364-9e97d154b750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b101b508-559c-4af2-b823-1dbc52a815a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b101b508-559c-4af2-b823-1dbc52a815a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1226559441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ae1d10-5053-4da4-8f54-a8a88d50e23e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fe8e6d68fc4b58a702be61e4e8b3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:40:35Z,use_quota=True,user_id='64d4aa22c4304774a9abda8daf37eb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (973bdf74-9f2e-4d67-a317-7222a02c6d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (973bdf74-9f2e-4d67-a317-7222a02c6d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099b9f9e-0e39-4857-bd98-dae2bb3ffc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099b9f9e-0e39-4857-bd98-dae2bb3ffc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ae1d10-5053-4da4-8f54-a8a88d50e23e', 'volume_name': 'volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3e7b3e-78fc-402f-b4f5-a205dc51b388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f3e7b3e-78fc-402f-b4f5-a205dc51b388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208ac0f2-10dc-46eb-872d-7c48f055eda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:34 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Volume 08ae1d10-5053-4da4-8f54-a8a88d50e23e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e', 'volume_size': 1} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1226559441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ae1d10-5053-4da4-8f54-a8a88d50e23e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fe8e6d68fc4b58a702be61e4e8b3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:40:35Z,use_quota=True,user_id='64d4aa22c4304774a9abda8daf37eb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Creating volume 08ae1d10-5053-4da4-8f54-a8a88d50e23e {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:40:34 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:40:34 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:34 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e 1073741824 Jul 23 22:40:34 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:35 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e 1073741824" returned: 0 in 0.405s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:35 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e Jul 23 22:40:35 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:35 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e" returned: 0 in 0.249s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:35 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:40:35 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208ac0f2-10dc-46eb-872d-7c48f055eda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4716f209-b82a-4e3c-8bfe-050f6c02cff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:35 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Volume volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e (08ae1d10-5053-4da4-8f54-a8a88d50e23e): created successfully Jul 23 22:40:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4716f209-b82a-4e3c-8bfe-050f6c02cff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:35 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Flow 'volume_create_manager' (70eb8cf0-18de-4dc0-b364-9e97d154b750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:40:35 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-3e925529-e17c-4bab-a3ce-5bd254aaff8b tempest-ProjectReaderTests-1636714853 None] Created volume successfully. Jul 23 22:40:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:36 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] Creating offline snapshot 0ae62934-c042-4d95-bd23-6cf61a302fb2 of volume 08ae1d10-5053-4da4-8f54-a8a88d50e23e {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:40:36 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d4fa52-1163-4a78-87c8-14c521abcd1f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:36 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e Jul 23 22:40:36 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:36 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e" returned: 0 in 0.355s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:36 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2 1G Jul 23 22:40:36 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:36 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2 1G" returned: 0 in 0.393s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:36 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:36 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2 Jul 23 22:40:36 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:37 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2" returned: 0 in 0.304s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:37 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2 is being set with open permissions: ugo+rw Jul 23 22:40:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:37 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2 Jul 23 22:40:37 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:37 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2" returned: 0 in 0.249s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:37 devstack sudo[109037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.info Jul 23 22:40:37 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:37 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.info" returned: 0 in 0.246s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:37 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.info is being set with open permissions: ugo+rw Jul 23 22:40:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:37 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.info Jul 23 22:40:37 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:37 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.info" returned: 0 in 0.247s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:37 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:37 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ef8f9803-57c1-4ff4-861a-495f79139783 tempest-ProjectReaderTests-1636714853 None] Create snapshot completed successfully Jul 23 22:40:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-0ae62934-c042-4d95-bd23-6cf61a302fb2-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Lock "cinder-0ae62934-c042-4d95-bd23-6cf61a302fb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-quobyte-08ae1d10-5053-4da4-8f54-a8a88d50e23e" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-08ae1d10-5053-4da4-8f54-a8a88d50e23e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-quobyte-0ae62934-c042-4d95-bd23-6cf61a302fb2" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:38 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-0ae62934-c042-4d95-bd23-6cf61a302fb2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:38 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Deleting offline snapshot 0ae62934-c042-4d95-bd23-6cf61a302fb2 of volume 08ae1d10-5053-4da4-8f54-a8a88d50e23e {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:40:38 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] snapshot_file for this snap is: volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:40:38 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9e986a-3c26-464f-86d1-c01b4ed51207]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:38 devstack sudo[109043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2 Jul 23 22:40:38 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:38 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2" returned: 0 in 0.343s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:38 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:40:38 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddecfbf-1d46-473c-a799-e92490ea7774]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:38 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:38 devstack sudo[109048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e Jul 23 22:40:38 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:39 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e" returned: 0 in 0.344s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:39 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2 Jul 23 22:40:39 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:39 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2" returned: 0 in 0.339s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:39 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2 Jul 23 22:40:39 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:39 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:39 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e.0ae62934-c042-4d95-bd23-6cf61a302fb2" returned: 0 in 0.245s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-0ae62934-c042-4d95-bd23-6cf61a302fb2" released by "_delete_snapshot" :: held 1.362s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-08ae1d10-5053-4da4-8f54-a8a88d50e23e" released by "delete_snapshot" :: held 1.385s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:39 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Created reservations ['5fc223c4-150c-4028-9c28-a67edb2451ad', 'b65202ff-f96d-46e7-a7a2-30c78e4c56c7', '46f67908-d22e-4718-8536-dcb2f2dbf6d9', '3522c3c2-e225-4830-9c9d-4401022746d2'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:40:39 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Delete snapshot completed successfully. Jul 23 22:40:39 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c95a2d7f-b7de-41c4-8a2c-c543e73ecb7d tempest-ProjectReaderTests-1636714853 None] Lock "cinder-0ae62934-c042-4d95-bd23-6cf61a302fb2-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-08ae1d10-5053-4da4-8f54-a8a88d50e23e-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Lock "cinder-08ae1d10-5053-4da4-8f54-a8a88d50e23e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-quobyte-08ae1d10-5053-4da4-8f54-a8a88d50e23e" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:40 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-08ae1d10-5053-4da4-8f54-a8a88d50e23e" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:40 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb7d5d1-c775-48d1-b4f4-4311547b7621]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:40 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e Jul 23 22:40:40 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:40 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e" returned: 0 in 0.349s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:40 devstack sudo[109067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e Jul 23 22:40:40 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:41 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-08ae1d10-5053-4da4-8f54-a8a88d50e23e" returned: 0 in 0.236s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-08ae1d10-5053-4da4-8f54-a8a88d50e23e" released by "delete_volume" :: held 0.639s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:41 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Created reservations ['979446da-224d-4f45-9974-03a03ea8c8af', '776a86cf-c111-404d-af84-673d88e8d3b2', '40e01b09-91d9-455e-98f2-b55a1a8283de', '745bd518-af85-474e-9289-dc49ea5c21d3'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:40:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:41 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:40:41 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:41 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.234s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:41 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:40:41 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Deleted volume successfully. Jul 23 22:40:41 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-67d80c3d-0031-417c-a220-a7e61208defd tempest-ProjectReaderTests-1636714853 None] Lock "cinder-08ae1d10-5053-4da4-8f54-a8a88d50e23e-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Flow 'volume_create_manager' (1ac18276-6c92-4936-8a23-681e69a8b25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70c01e9-9ec3-4faa-b6e7-32ac63b99094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70c01e9-9ec3-4faa-b6e7-32ac63b99094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1340995479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde0d006-7062-418b-9da1-07f67e86a628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fe8e6d68fc4b58a702be61e4e8b3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:40:42Z,use_quota=True,user_id='64d4aa22c4304774a9abda8daf37eb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694550ae-f0d7-4613-9be1-e85b5b8ea965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694550ae-f0d7-4613-9be1-e85b5b8ea965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf0ab36-718f-4ce4-92b1-599241d9c0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf0ab36-718f-4ce4-92b1-599241d9c0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde0d006-7062-418b-9da1-07f67e86a628', 'volume_name': 'volume-bde0d006-7062-418b-9da1-07f67e86a628', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81885fdf-33eb-4963-9433-f5a0c09baf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81885fdf-33eb-4963-9433-f5a0c09baf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c1d090-986e-4629-a013-275042746170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:42 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Volume bde0d006-7062-418b-9da1-07f67e86a628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde0d006-7062-418b-9da1-07f67e86a628', 'volume_size': 1} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1340995479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde0d006-7062-418b-9da1-07f67e86a628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fe8e6d68fc4b58a702be61e4e8b3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:40:42Z,use_quota=True,user_id='64d4aa22c4304774a9abda8daf37eb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Creating volume bde0d006-7062-418b-9da1-07f67e86a628 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:40:42 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:42 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628 1073741824 Jul 23 22:40:42 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:42 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628 1073741824" returned: 0 in 0.409s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:42 devstack sudo[109078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628 Jul 23 22:40:42 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:42 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628" returned: 0 in 0.244s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c1d090-986e-4629-a013-275042746170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde0d006-7062-418b-9da1-07f67e86a628', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109576c1-91c2-4b2b-ae95-7387392c3b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:42 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Volume volume-bde0d006-7062-418b-9da1-07f67e86a628 (bde0d006-7062-418b-9da1-07f67e86a628): created successfully Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109576c1-91c2-4b2b-ae95-7387392c3b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:42 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Flow 'volume_create_manager' (1ac18276-6c92-4936-8a23-681e69a8b25f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:40:42 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-964d19ed-932d-4468-bf1e-9bc4e1194f40 tempest-ProjectReaderTests-1636714853 None] Created volume successfully. Jul 23 22:40:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:43 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] Creating offline snapshot 8bbd35b8-c284-465b-bf32-9c67e25bc0e1 of volume bde0d006-7062-418b-9da1-07f67e86a628 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:40:43 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e34afe-0bdb-4bca-b6ac-61d930748252]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:43 devstack sudo[109081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628 Jul 23 22:40:43 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:43 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628" returned: 0 in 0.346s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:43 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1 1G Jul 23 22:40:43 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:43 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1 1G" returned: 0 in 0.381s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde0d006-7062-418b-9da1-07f67e86a628 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:43 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde0d006-7062-418b-9da1-07f67e86a628 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1 Jul 23 22:40:43 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:44 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde0d006-7062-418b-9da1-07f67e86a628 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1" returned: 0 in 0.290s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:44 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1 is being set with open permissions: ugo+rw Jul 23 22:40:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:44 devstack sudo[109096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1 Jul 23 22:40:44 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:44 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1" returned: 0 in 0.238s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:44 devstack sudo[109099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.info Jul 23 22:40:44 devstack sudo[109099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:44 devstack sudo[109099]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.info" returned: 0 in 0.247s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:44 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.info is being set with open permissions: ugo+rw Jul 23 22:40:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:44 devstack sudo[109102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.info Jul 23 22:40:44 devstack sudo[109102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:44 devstack sudo[109102]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.info" returned: 0 in 0.240s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:45 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c4cdc7fa-8254-487d-8cb1-c7c505507f13 tempest-ProjectReaderTests-1636714853 None] Create snapshot completed successfully Jul 23 22:40:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-8bbd35b8-c284-465b-bf32-9c67e25bc0e1-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-8bbd35b8-c284-465b-bf32-9c67e25bc0e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-quobyte-bde0d006-7062-418b-9da1-07f67e86a628" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-bde0d006-7062-418b-9da1-07f67e86a628" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-quobyte-8bbd35b8-c284-465b-bf32-9c67e25bc0e1" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:45 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-8bbd35b8-c284-465b-bf32-9c67e25bc0e1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Deleting offline snapshot 8bbd35b8-c284-465b-bf32-9c67e25bc0e1 of volume bde0d006-7062-418b-9da1-07f67e86a628 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:40:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] snapshot_file for this snap is: volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:40:45 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[34632c7c-a368-4744-bb52-fadff5959cf1]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:45 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1 Jul 23 22:40:45 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:45 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1" returned: 0 in 0.359s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:45 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bde0d006-7062-418b-9da1-07f67e86a628(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:40:45 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[53db3920-5487-4312-ac92-ffb47668ab9c]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:45 devstack sudo[109110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628 Jul 23 22:40:45 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:46 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628" returned: 0 in 0.340s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:46 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1 Jul 23 22:40:46 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:46 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1" returned: 0 in 0.348s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:46 devstack sudo[109120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1 Jul 23 22:40:46 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:46 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:46 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628.8bbd35b8-c284-465b-bf32-9c67e25bc0e1" returned: 0 in 0.243s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-8bbd35b8-c284-465b-bf32-9c67e25bc0e1" released by "_delete_snapshot" :: held 1.373s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-bde0d006-7062-418b-9da1-07f67e86a628" released by "delete_snapshot" :: held 1.393s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:46 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Created reservations ['c3cc3945-f097-41c1-a1e5-9765145e0d16', '717c52d1-9aca-4f94-97c1-75db9615e054', '9514ad33-c457-4e15-b2d4-c1a32975fee3', '54ac672d-f61c-4452-bfb8-759c38251eab'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:40:46 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Delete snapshot completed successfully. Jul 23 22:40:46 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-091a866e-0207-4f6d-aa08-159dca19f377 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-8bbd35b8-c284-465b-bf32-9c67e25bc0e1-delete_snapshot" released by "delete_snapshot" :: held 1.514s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-bde0d006-7062-418b-9da1-07f67e86a628-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Lock "cinder-bde0d006-7062-418b-9da1-07f67e86a628-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-quobyte-bde0d006-7062-418b-9da1-07f67e86a628" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:47 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-bde0d006-7062-418b-9da1-07f67e86a628" acquired by "delete_volume" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:47 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50c57de-1186-474d-bc84-b9ce81cf4284]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:47 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628 Jul 23 22:40:47 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:47 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628" returned: 0 in 0.351s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:47 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:47 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628 Jul 23 22:40:47 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:48 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-bde0d006-7062-418b-9da1-07f67e86a628" returned: 0 in 0.240s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-bde0d006-7062-418b-9da1-07f67e86a628" released by "delete_volume" :: held 0.651s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:48 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Created reservations ['aa0408b4-97fc-4b90-9c78-00d66066be87', '4629175e-4264-416f-95d1-cbafa5923d2c', 'bc42a97e-8bf5-4943-b354-6fdcc795c19f', '6ce6ce14-6309-4e7d-ab64-3e3e00f30e37'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:40:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:48 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:48 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:40:48 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:48 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:48 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.235s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:48 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:40:48 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Deleted volume successfully. Jul 23 22:40:48 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2b3f5c6f-4f45-412c-b844-3aa0e583cb2c tempest-ProjectReaderTests-1636714853 None] Lock "cinder-bde0d006-7062-418b-9da1-07f67e86a628-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Flow 'volume_create_manager' (f2c3c16e-f712-46a1-a46c-028930e178e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01368b6e-a260-4d11-bb6d-fb9b963c599e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01368b6e-a260-4d11-bb6d-fb9b963c599e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-613136825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9513bcaa-7a1b-420a-aa96-4f00e624e763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fe8e6d68fc4b58a702be61e4e8b3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:40:49Z,use_quota=True,user_id='64d4aa22c4304774a9abda8daf37eb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c918ab58-7d2d-4933-b7a2-63c22413966e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c918ab58-7d2d-4933-b7a2-63c22413966e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414a4134-ffa9-4c32-a9d7-7aa8fa82f330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414a4134-ffa9-4c32-a9d7-7aa8fa82f330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9513bcaa-7a1b-420a-aa96-4f00e624e763', 'volume_name': 'volume-9513bcaa-7a1b-420a-aa96-4f00e624e763', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5351ded-0f18-41ea-901d-90b973bda064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5351ded-0f18-41ea-901d-90b973bda064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e069eb8c-497c-4e97-bb49-3d3b1fe966c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:49 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Volume 9513bcaa-7a1b-420a-aa96-4f00e624e763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9513bcaa-7a1b-420a-aa96-4f00e624e763', 'volume_size': 1} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-613136825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9513bcaa-7a1b-420a-aa96-4f00e624e763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fe8e6d68fc4b58a702be61e4e8b3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:40:49Z,use_quota=True,user_id='64d4aa22c4304774a9abda8daf37eb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Creating volume 9513bcaa-7a1b-420a-aa96-4f00e624e763 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:40:49 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:49 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 1073741824 Jul 23 22:40:49 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:49 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 1073741824" returned: 0 in 0.404s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:49 devstack sudo[109144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 Jul 23 22:40:49 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:49 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763" returned: 0 in 0.238s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e069eb8c-497c-4e97-bb49-3d3b1fe966c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9513bcaa-7a1b-420a-aa96-4f00e624e763', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e226815d-1958-4d03-afc2-914b65d345c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:49 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Volume volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 (9513bcaa-7a1b-420a-aa96-4f00e624e763): created successfully Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e226815d-1958-4d03-afc2-914b65d345c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:49 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Flow 'volume_create_manager' (f2c3c16e-f712-46a1-a46c-028930e178e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:40:49 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a8b28c89-3fbd-40e3-bf09-1f647ac232da tempest-ProjectReaderTests-1636714853 None] Created volume successfully. Jul 23 22:40:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] Creating offline snapshot a2e236f1-7e12-4a1a-ab27-e302a5f3c6be of volume 9513bcaa-7a1b-420a-aa96-4f00e624e763 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:40:50 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f6b35a-d8f7-4e83-a0c2-153b4582a452]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:50 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 Jul 23 22:40:50 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:50 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763" returned: 0 in 0.346s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:50 devstack sudo[109152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be 1G Jul 23 22:40:50 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:50 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be 1G" returned: 0 in 0.385s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:50 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be Jul 23 22:40:50 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:51 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be" returned: 0 in 0.295s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:51 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be is being set with open permissions: ugo+rw Jul 23 22:40:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:51 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be Jul 23 22:40:51 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:51 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be" returned: 0 in 0.242s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:51 devstack sudo[109166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.info Jul 23 22:40:51 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:51 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.info" returned: 0 in 0.246s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:51 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.info is being set with open permissions: ugo+rw Jul 23 22:40:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:51 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.info Jul 23 22:40:51 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:52 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.info" returned: 0 in 0.243s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:52 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-73069218-0a95-4b14-8193-e1b36c4184d1 tempest-ProjectReaderTests-1636714853 None] Create snapshot completed successfully Jul 23 22:40:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-a2e236f1-7e12-4a1a-ab27-e302a5f3c6be-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-a2e236f1-7e12-4a1a-ab27-e302a5f3c6be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-quobyte-9513bcaa-7a1b-420a-aa96-4f00e624e763" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-9513bcaa-7a1b-420a-aa96-4f00e624e763" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-quobyte-a2e236f1-7e12-4a1a-ab27-e302a5f3c6be" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-a2e236f1-7e12-4a1a-ab27-e302a5f3c6be" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Deleting offline snapshot a2e236f1-7e12-4a1a-ab27-e302a5f3c6be of volume 9513bcaa-7a1b-420a-aa96-4f00e624e763 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:40:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] snapshot_file for this snap is: volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:40:52 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d826bc5-1da2-4aec-86e8-46201279d7c2]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:52 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be Jul 23 22:40:52 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:52 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be" returned: 0 in 0.352s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:52 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9513bcaa-7a1b-420a-aa96-4f00e624e763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:40:52 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b38fb2c-b235-4eb3-83db-ad645e4ede65]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:52 devstack sudo[109177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 Jul 23 22:40:52 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:53 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763" returned: 0 in 0.356s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:53 devstack sudo[109182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be Jul 23 22:40:53 devstack sudo[109182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:53 devstack sudo[109182]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be" returned: 0 in 0.335s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:53 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be Jul 23 22:40:53 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:53 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763.a2e236f1-7e12-4a1a-ab27-e302a5f3c6be" returned: 0 in 0.240s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-a2e236f1-7e12-4a1a-ab27-e302a5f3c6be" released by "_delete_snapshot" :: held 1.369s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-9513bcaa-7a1b-420a-aa96-4f00e624e763" released by "delete_snapshot" :: held 1.389s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:53 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Created reservations ['1830444f-a148-4f04-bf8d-9d92ba3ddf49', 'ffe206ca-0bec-42e0-a861-34fb5a14da5d', 'e41f6d7a-d18b-4ce3-b0f3-8ea368c0583d', 'ad891802-6643-46d7-a85d-c4cd56d6bd2b'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:40:53 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Delete snapshot completed successfully. Jul 23 22:40:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8fa7b25b-e28e-4a54-b04f-a8b5e0781856 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-a2e236f1-7e12-4a1a-ab27-e302a5f3c6be-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-9513bcaa-7a1b-420a-aa96-4f00e624e763-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-9513bcaa-7a1b-420a-aa96-4f00e624e763-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-quobyte-9513bcaa-7a1b-420a-aa96-4f00e624e763" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-9513bcaa-7a1b-420a-aa96-4f00e624e763" acquired by "delete_volume" :: waited 0.015s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:54 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4d5424-33cc-466e-b793-46aa61e4a1c1]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:54 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 Jul 23 22:40:54 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:54 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763" returned: 0 in 0.345s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:54 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763 Jul 23 22:40:54 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:55 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9513bcaa-7a1b-420a-aa96-4f00e624e763" returned: 0 in 0.235s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-9513bcaa-7a1b-420a-aa96-4f00e624e763" released by "delete_volume" :: held 0.632s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:55 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Created reservations ['de689d4c-1eee-494a-84b0-610585f5984c', 'ccf4855b-ed1e-4e43-a172-339a81dde0ad', '6fd47522-bb24-4fb1-aec7-4057d2789384', 'a17a18c1-f930-48df-9a0c-ed11fb8cc8cf'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:40:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:55 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:55 devstack sudo[109198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:40:55 devstack sudo[109198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:55 devstack sudo[109198]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.237s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:55 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:40:55 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Deleted volume successfully. Jul 23 22:40:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-ee73ee9d-94ff-4657-863d-fa450194dba1 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-9513bcaa-7a1b-420a-aa96-4f00e624e763-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Flow 'volume_create_manager' (03c34646-d986-4f50-97d5-018139a149d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4dd975e-8de6-44a2-becd-0a8dd8588f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4dd975e-8de6-44a2-becd-0a8dd8588f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983480671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58de9d5a-b001-4f87-a62b-c5c820c2821f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fe8e6d68fc4b58a702be61e4e8b3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:40:56Z,use_quota=True,user_id='64d4aa22c4304774a9abda8daf37eb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96156331-93d8-4873-830a-1d3c1adaf292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96156331-93d8-4873-830a-1d3c1adaf292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beddcd07-db70-4624-8d71-7ae636febd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beddcd07-db70-4624-8d71-7ae636febd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58de9d5a-b001-4f87-a62b-c5c820c2821f', 'volume_name': 'volume-58de9d5a-b001-4f87-a62b-c5c820c2821f', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd1679e-55e5-44d4-9274-1679ed387182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd1679e-55e5-44d4-9274-1679ed387182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92208bf0-9d9b-4a18-9832-c1a7a6c01a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:56 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Volume 58de9d5a-b001-4f87-a62b-c5c820c2821f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58de9d5a-b001-4f87-a62b-c5c820c2821f', 'volume_size': 1} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983480671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58de9d5a-b001-4f87-a62b-c5c820c2821f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fe8e6d68fc4b58a702be61e4e8b3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:40:56Z,use_quota=True,user_id='64d4aa22c4304774a9abda8daf37eb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Creating volume 58de9d5a-b001-4f87-a62b-c5c820c2821f {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:40:56 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:56 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f 1073741824 Jul 23 22:40:56 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:56 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f 1073741824" returned: 0 in 0.400s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:56 devstack sudo[109206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f Jul 23 22:40:56 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:56 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f" returned: 0 in 0.239s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92208bf0-9d9b-4a18-9832-c1a7a6c01a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58de9d5a-b001-4f87-a62b-c5c820c2821f', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778ce68c-b2ff-4733-9f33-27a2291187d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:40:56 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Volume volume-58de9d5a-b001-4f87-a62b-c5c820c2821f (58de9d5a-b001-4f87-a62b-c5c820c2821f): created successfully Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778ce68c-b2ff-4733-9f33-27a2291187d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:40:56 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Flow 'volume_create_manager' (03c34646-d986-4f50-97d5-018139a149d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:40:56 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-00d9b15b-f0cb-4aca-b8a0-453867679702 tempest-ProjectReaderTests-1636714853 None] Created volume successfully. Jul 23 22:40:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:40:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:40:57 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] Creating offline snapshot 48715c51-0e58-4f3e-b6af-6a781a9d85fe of volume 58de9d5a-b001-4f87-a62b-c5c820c2821f {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:40:57 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9e66c0-a8a1-4cc5-b5fe-d53352fba17b]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:57 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f Jul 23 22:40:57 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:57 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f" returned: 0 in 0.343s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:57 devstack sudo[109214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe 1G Jul 23 22:40:57 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:57 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe 1G" returned: 0 in 0.382s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:57 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58de9d5a-b001-4f87-a62b-c5c820c2821f -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:57 devstack sudo[109219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58de9d5a-b001-4f87-a62b-c5c820c2821f -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe Jul 23 22:40:57 devstack sudo[109219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:58 devstack sudo[109219]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58de9d5a-b001-4f87-a62b-c5c820c2821f -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe" returned: 0 in 0.287s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:58 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe is being set with open permissions: ugo+rw Jul 23 22:40:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:58 devstack sudo[109225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe Jul 23 22:40:58 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:58 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe" returned: 0 in 0.234s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:58 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.info Jul 23 22:40:58 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:58 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.info" returned: 0 in 0.251s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:58 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.info is being set with open permissions: ugo+rw Jul 23 22:40:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:58 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.info Jul 23 22:40:58 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:58 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.info" returned: 0 in 0.241s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:58 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.815s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:40:59 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-785c9fd4-0397-4786-8d82-000616968402 tempest-ProjectReaderTests-1636714853 None] Create snapshot completed successfully Jul 23 22:40:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-48715c51-0e58-4f3e-b6af-6a781a9d85fe-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-48715c51-0e58-4f3e-b6af-6a781a9d85fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-quobyte-58de9d5a-b001-4f87-a62b-c5c820c2821f" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-58de9d5a-b001-4f87-a62b-c5c820c2821f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-quobyte-48715c51-0e58-4f3e-b6af-6a781a9d85fe" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:40:59 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-48715c51-0e58-4f3e-b6af-6a781a9d85fe" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:40:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Deleting offline snapshot 48715c51-0e58-4f3e-b6af-6a781a9d85fe of volume 58de9d5a-b001-4f87-a62b-c5c820c2821f {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:40:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] snapshot_file for this snap is: volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:40:59 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e78bf0-d1f3-4f22-95b4-ebc19bbdf328]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:59 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe Jul 23 22:40:59 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:40:59 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Jul 23 22:40:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe" returned: 0 in 0.378s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:40:59 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58de9d5a-b001-4f87-a62b-c5c820c2821f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:40:59 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d402547-027c-41dc-b142-bf620b98845f]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:40:59 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:40:59 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f Jul 23 22:40:59 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:00 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f" returned: 0 in 0.342s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:00 devstack sudo[109247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe Jul 23 22:41:00 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:00 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe" returned: 0 in 0.328s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:00 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe Jul 23 22:41:00 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:00 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:00 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f.48715c51-0e58-4f3e-b6af-6a781a9d85fe" returned: 0 in 0.251s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-48715c51-0e58-4f3e-b6af-6a781a9d85fe" released by "_delete_snapshot" :: held 1.391s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-58de9d5a-b001-4f87-a62b-c5c820c2821f" released by "delete_snapshot" :: held 1.409s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:00 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Created reservations ['de408a5b-c6d6-46af-ab65-8109d13b95b7', '7f31bb1b-dc96-47e9-a03c-5fd6aeda9663', 'd3140791-dde4-4ce9-ad55-148cc0cff264', '1fa5bd30-8a08-415d-88e9-657fc2cb97ed'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:41:00 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Delete snapshot completed successfully. Jul 23 22:41:00 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-41c10403-0130-4620-8679-eca79562e405 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-48715c51-0e58-4f3e-b6af-6a781a9d85fe-delete_snapshot" released by "delete_snapshot" :: held 1.535s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:01 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-58de9d5a-b001-4f87-a62b-c5c820c2821f-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:01 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-58de9d5a-b001-4f87-a62b-c5c820c2821f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:01 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-quobyte-58de9d5a-b001-4f87-a62b-c5c820c2821f" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:01 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-58de9d5a-b001-4f87-a62b-c5c820c2821f" acquired by "delete_volume" :: waited 0.018s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:01 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3f52b4-81f3-496e-896e-eb74e6c1a6ee]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:41:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:01 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f Jul 23 22:41:01 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:01 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f" returned: 0 in 0.345s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:01 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:01 devstack sudo[109260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f Jul 23 22:41:01 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:02 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-58de9d5a-b001-4f87-a62b-c5c820c2821f" returned: 0 in 0.244s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:02 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-58de9d5a-b001-4f87-a62b-c5c820c2821f" released by "delete_volume" :: held 0.640s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:02 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Created reservations ['714b49d8-ec7e-45d0-83ef-d3f9a229b20a', 'a782bba5-957a-4a40-829b-0c7c15ac43d8', '0bbb2a2a-4fa6-4340-88ba-0284601ab3b2', '96e8b7cf-aaa6-4a6a-a143-b478cc57f166'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:41:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:02 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:41:02 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:41:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:02 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:41:02 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:02 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:02 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.240s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:02 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:41:02 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Deleted volume successfully. Jul 23 22:41:02 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-052ad075-d638-474b-b455-94d31241d8d0 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-58de9d5a-b001-4f87-a62b-c5c820c2821f-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Flow 'volume_create_manager' (f9fd571b-9ad1-410c-a1ef-70338920137c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7577a0b2-7271-4b28-bb95-4b05b9add0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7577a0b2-7271-4b28-bb95-4b05b9add0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1165950780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9478258f-b50d-4b9b-a0d3-c481afd8c733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fe8e6d68fc4b58a702be61e4e8b3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:41:03Z,use_quota=True,user_id='64d4aa22c4304774a9abda8daf37eb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892fdeaf-428b-458e-a715-b89f0c6ca67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892fdeaf-428b-458e-a715-b89f0c6ca67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbd63c7-b655-43d8-8356-b6f039ccd852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbd63c7-b655-43d8-8356-b6f039ccd852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9478258f-b50d-4b9b-a0d3-c481afd8c733', 'volume_name': 'volume-9478258f-b50d-4b9b-a0d3-c481afd8c733', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef80cb2-80f9-4d4e-8008-be3feb3a2114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef80cb2-80f9-4d4e-8008-be3feb3a2114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3674e31-96f4-4e48-ae08-9d82cad66b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:03 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Volume 9478258f-b50d-4b9b-a0d3-c481afd8c733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9478258f-b50d-4b9b-a0d3-c481afd8c733', 'volume_size': 1} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1165950780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9478258f-b50d-4b9b-a0d3-c481afd8c733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fe8e6d68fc4b58a702be61e4e8b3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:41:03Z,use_quota=True,user_id='64d4aa22c4304774a9abda8daf37eb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Creating volume 9478258f-b50d-4b9b-a0d3-c481afd8c733 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:41:03 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:03 devstack sudo[109266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 1073741824 Jul 23 22:41:03 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:03 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 1073741824" returned: 0 in 0.398s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:03 devstack sudo[109271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 Jul 23 22:41:03 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:03 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733" returned: 0 in 0.241s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3674e31-96f4-4e48-ae08-9d82cad66b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9478258f-b50d-4b9b-a0d3-c481afd8c733', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74cda5c-e578-4457-bd6c-ea3f8495b174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:03 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Volume volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 (9478258f-b50d-4b9b-a0d3-c481afd8c733): created successfully Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74cda5c-e578-4457-bd6c-ea3f8495b174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:03 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Flow 'volume_create_manager' (f9fd571b-9ad1-410c-a1ef-70338920137c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:41:03 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-d3c0ca1e-08bd-4298-86b2-ecf8993cd9be tempest-ProjectReaderTests-1636714853 None] Created volume successfully. Jul 23 22:41:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:04 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] Creating offline snapshot e1c64d11-001f-4823-8346-eaa9833f6af4 of volume 9478258f-b50d-4b9b-a0d3-c481afd8c733 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:41:04 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ce2484-81b9-4a07-b3a8-255a6cd75191]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:41:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:04 devstack sudo[109274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 Jul 23 22:41:04 devstack sudo[109274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:04 devstack sudo[109274]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733" returned: 0 in 0.354s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:04 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4 1G Jul 23 22:41:04 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:04 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4 1G" returned: 0 in 0.383s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:04 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:04 devstack sudo[109284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4 Jul 23 22:41:04 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:05 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4" returned: 0 in 0.288s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:05 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4 is being set with open permissions: ugo+rw Jul 23 22:41:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:05 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4 Jul 23 22:41:05 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:05 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4" returned: 0 in 0.239s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:05 devstack sudo[109292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.info Jul 23 22:41:05 devstack sudo[109292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:05 devstack sudo[109292]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.info" returned: 0 in 0.248s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:05 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.info is being set with open permissions: ugo+rw Jul 23 22:41:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:05 devstack sudo[109295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.info Jul 23 22:41:05 devstack sudo[109295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:05 devstack sudo[109295]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.info" returned: 0 in 0.247s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:05 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:06 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a20534a1-3124-4cb1-abc0-160243a83d80 tempest-ProjectReaderTests-1636714853 None] Create snapshot completed successfully Jul 23 22:41:06 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-e1c64d11-001f-4823-8346-eaa9833f6af4-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:06 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Lock "cinder-e1c64d11-001f-4823-8346-eaa9833f6af4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:06 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-quobyte-9478258f-b50d-4b9b-a0d3-c481afd8c733" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:06 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-9478258f-b50d-4b9b-a0d3-c481afd8c733" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:06 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-quobyte-e1c64d11-001f-4823-8346-eaa9833f6af4" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:06 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-e1c64d11-001f-4823-8346-eaa9833f6af4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Deleting offline snapshot e1c64d11-001f-4823-8346-eaa9833f6af4 of volume 9478258f-b50d-4b9b-a0d3-c481afd8c733 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:41:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] snapshot_file for this snap is: volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:41:06 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af74892-7705-4770-9431-4560648ae8f1]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:41:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:06 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4 Jul 23 22:41:06 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:06 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4" returned: 0 in 0.348s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:06 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9478258f-b50d-4b9b-a0d3-c481afd8c733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:41:06 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[896b0bc7-8020-4d5e-93a0-f5b7a2b7d39d]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:41:06 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:06 devstack sudo[109303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 Jul 23 22:41:06 devstack sudo[109303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:07 devstack sudo[109303]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733" returned: 0 in 0.344s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:07 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4 Jul 23 22:41:07 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:07 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4" returned: 0 in 0.337s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:07 devstack sudo[109313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4 Jul 23 22:41:07 devstack sudo[109313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:07 devstack sudo[109313]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:07 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733.e1c64d11-001f-4823-8346-eaa9833f6af4" returned: 0 in 0.243s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-e1c64d11-001f-4823-8346-eaa9833f6af4" released by "_delete_snapshot" :: held 1.357s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-9478258f-b50d-4b9b-a0d3-c481afd8c733" released by "delete_snapshot" :: held 1.378s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:07 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Created reservations ['49ac421e-d422-46aa-9f73-319b21f9dd32', '81f02f70-464b-4e69-bf7c-3a0e949d2c06', '6ea1af82-a5e7-4a71-ba13-118e3aa170a8', 'feb1a33d-eadf-48d0-bb5b-753ba8f1e712'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:41:07 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Delete snapshot completed successfully. Jul 23 22:41:07 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-d84bcd32-4453-44f6-bcf3-7be47e7b5dbd tempest-ProjectReaderTests-1636714853 None] Lock "cinder-e1c64d11-001f-4823-8346-eaa9833f6af4-delete_snapshot" released by "delete_snapshot" :: held 1.502s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:08 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-9478258f-b50d-4b9b-a0d3-c481afd8c733-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:08 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-9478258f-b50d-4b9b-a0d3-c481afd8c733-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:08 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "cinder-quobyte-9478258f-b50d-4b9b-a0d3-c481afd8c733" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:08 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-9478258f-b50d-4b9b-a0d3-c481afd8c733" acquired by "delete_volume" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:08 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bc22dd-75c1-404c-adcf-6f8c89742b4a]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:41:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:08 devstack sudo[109316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 Jul 23 22:41:08 devstack sudo[109316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:08 devstack sudo[109316]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733" returned: 0 in 0.348s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:08 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:08 devstack sudo[109321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733 Jul 23 22:41:08 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:09 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-9478258f-b50d-4b9b-a0d3-c481afd8c733" returned: 0 in 0.246s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-quobyte-9478258f-b50d-4b9b-a0d3-c481afd8c733" released by "delete_volume" :: held 0.653s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:09 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Created reservations ['3d7c7a24-45f9-4436-bfc2-81c20536a880', '53fc9c85-0040-4fd1-84a0-cc0020859ad2', '421fc1da-1902-45cb-9577-f6330352fc79', '774dc220-5a01-4d77-b8b7-0ef15429e9c1'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:41:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:41:09 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:41:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:09 devstack sudo[109324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:41:09 devstack sudo[109324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:09 devstack sudo[109324]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:09 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.243s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:09 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:41:09 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Deleted volume successfully. Jul 23 22:41:09 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-8b31b012-ff68-4eec-8cac-95ec3bfa33c2 tempest-ProjectReaderTests-1636714853 None] Lock "cinder-9478258f-b50d-4b9b-a0d3-c481afd8c733-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Flow 'volume_create_manager' (1c98f5d6-a561-47d4-9d4c-d53150adcbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cf961e-1de9-496e-8d25-3ecc7b069fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cf961e-1de9-496e-8d25-3ecc7b069fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-449182286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95761296-b1bf-4eff-b8fe-4caaaba2d4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9acb92253884e15831edef64207bab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:41:13Z,use_quota=True,user_id='423e663134e14244a3aeaaf59264fee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a100996b-7bb1-442c-8abf-af1c6596f424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a100996b-7bb1-442c-8abf-af1c6596f424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621ce411-7ef4-4b5a-80ed-1f4887c6d689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621ce411-7ef4-4b5a-80ed-1f4887c6d689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95761296-b1bf-4eff-b8fe-4caaaba2d4a4', 'volume_name': 'volume-95761296-b1bf-4eff-b8fe-4caaaba2d4a4', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181d046c-5079-4403-9236-2da9b59c23e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181d046c-5079-4403-9236-2da9b59c23e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22aa338a-613d-482f-809e-3a687985e988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:13 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Volume 95761296-b1bf-4eff-b8fe-4caaaba2d4a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95761296-b1bf-4eff-b8fe-4caaaba2d4a4', 'volume_size': 1} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-449182286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95761296-b1bf-4eff-b8fe-4caaaba2d4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9acb92253884e15831edef64207bab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:41:13Z,use_quota=True,user_id='423e663134e14244a3aeaaf59264fee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Creating volume 95761296-b1bf-4eff-b8fe-4caaaba2d4a4 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:41:13 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-95761296-b1bf-4eff-b8fe-4caaaba2d4a4 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:13 devstack sudo[109329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-95761296-b1bf-4eff-b8fe-4caaaba2d4a4 1073741824 Jul 23 22:41:13 devstack sudo[109329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:13 devstack sudo[109329]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-95761296-b1bf-4eff-b8fe-4caaaba2d4a4 1073741824" returned: 0 in 0.405s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-95761296-b1bf-4eff-b8fe-4caaaba2d4a4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:13 devstack sudo[109334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-95761296-b1bf-4eff-b8fe-4caaaba2d4a4 Jul 23 22:41:13 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:13 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-95761296-b1bf-4eff-b8fe-4caaaba2d4a4" returned: 0 in 0.232s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22aa338a-613d-482f-809e-3a687985e988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95761296-b1bf-4eff-b8fe-4caaaba2d4a4', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb247240-821a-46b8-9323-b09f4550a04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:13 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Volume volume-95761296-b1bf-4eff-b8fe-4caaaba2d4a4 (95761296-b1bf-4eff-b8fe-4caaaba2d4a4): created successfully Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb247240-821a-46b8-9323-b09f4550a04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:13 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Flow 'volume_create_manager' (1c98f5d6-a561-47d4-9d4c-d53150adcbc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:41:13 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-fc99bb12-2c11-4627-8417-ef39e57460bb tempest-ProjectReaderTests-1898984603 None] Created volume successfully. Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Acquiring lock "cinder-95761296-b1bf-4eff-b8fe-4caaaba2d4a4-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Lock "cinder-95761296-b1bf-4eff-b8fe-4caaaba2d4a4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Acquiring lock "cinder-quobyte-95761296-b1bf-4eff-b8fe-4caaaba2d4a4" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Lock "cinder-quobyte-95761296-b1bf-4eff-b8fe-4caaaba2d4a4" acquired by "delete_volume" :: waited 0.013s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a0a329-29c4-4195-8b05-472adc9fae0e]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-95761296-b1bf-4eff-b8fe-4caaaba2d4a4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:14 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-95761296-b1bf-4eff-b8fe-4caaaba2d4a4 Jul 23 22:41:14 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:14 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-95761296-b1bf-4eff-b8fe-4caaaba2d4a4" returned: 0 in 0.358s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-95761296-b1bf-4eff-b8fe-4caaaba2d4a4 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:14 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-95761296-b1bf-4eff-b8fe-4caaaba2d4a4 Jul 23 22:41:14 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:14 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-95761296-b1bf-4eff-b8fe-4caaaba2d4a4" returned: 0 in 0.238s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Lock "cinder-quobyte-95761296-b1bf-4eff-b8fe-4caaaba2d4a4" released by "delete_volume" :: held 0.635s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Created reservations ['fb73cea5-0067-4ef0-b30b-7b5954fc9f6d', 'bd9e1b57-6b1f-4db1-ad00-226313897916', '0e84d21c-8746-4ab0-9968-7e1f5cd4aaaa', 'cf13199a-3d50-4678-9213-4d8d1b89bd10'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:14 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:14 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:41:14 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:15 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.251s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:41:15 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Deleted volume successfully. Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-2662a119-22fe-418d-968f-c7d04827abd0 tempest-ProjectReaderTests-1898984603 None] Lock "cinder-95761296-b1bf-4eff-b8fe-4caaaba2d4a4-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Flow 'volume_create_manager' (c3e15c14-4bc2-4991-b28a-063fc89554bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac011ff-49b5-4c36-b2b1-c72ae1175d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac011ff-49b5-4c36-b2b1-c72ae1175d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1029784052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77201544-c786-4c1d-bcd5-8c2eac399021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9acb92253884e15831edef64207bab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:41:16Z,use_quota=True,user_id='423e663134e14244a3aeaaf59264fee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a44d00e-f3ba-48c2-ad6a-c3e5295128b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a44d00e-f3ba-48c2-ad6a-c3e5295128b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a0c908-9e65-4bec-8513-af24abaeb6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a0c908-9e65-4bec-8513-af24abaeb6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77201544-c786-4c1d-bcd5-8c2eac399021', 'volume_name': 'volume-77201544-c786-4c1d-bcd5-8c2eac399021', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (245565ba-a95f-47fc-a11e-ceb371c351f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (245565ba-a95f-47fc-a11e-ceb371c351f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8215069c-abb4-4cae-bf49-533f8908a5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:15 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Volume 77201544-c786-4c1d-bcd5-8c2eac399021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77201544-c786-4c1d-bcd5-8c2eac399021', 'volume_size': 1} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1029784052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77201544-c786-4c1d-bcd5-8c2eac399021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9acb92253884e15831edef64207bab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:41:16Z,use_quota=True,user_id='423e663134e14244a3aeaaf59264fee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Creating volume 77201544-c786-4c1d-bcd5-8c2eac399021 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:41:15 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:41:15 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-77201544-c786-4c1d-bcd5-8c2eac399021 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:15 devstack sudo[109348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-77201544-c786-4c1d-bcd5-8c2eac399021 1073741824 Jul 23 22:41:15 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:16 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-77201544-c786-4c1d-bcd5-8c2eac399021 1073741824" returned: 0 in 0.404s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-77201544-c786-4c1d-bcd5-8c2eac399021 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:16 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-77201544-c786-4c1d-bcd5-8c2eac399021 Jul 23 22:41:16 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:16 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-77201544-c786-4c1d-bcd5-8c2eac399021" returned: 0 in 0.238s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:16 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:41:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8215069c-abb4-4cae-bf49-533f8908a5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77201544-c786-4c1d-bcd5-8c2eac399021', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7983d68-c37a-4645-93ae-a39b1a7ff5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:16 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Volume volume-77201544-c786-4c1d-bcd5-8c2eac399021 (77201544-c786-4c1d-bcd5-8c2eac399021): created successfully Jul 23 22:41:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7983d68-c37a-4645-93ae-a39b1a7ff5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:16 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Flow 'volume_create_manager' (c3e15c14-4bc2-4991-b28a-063fc89554bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:41:16 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-817de8e9-6911-4a82-88a4-76ad09ea945d tempest-ProjectReaderTests-1898984603 None] Created volume successfully. Jul 23 22:41:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Acquiring lock "cinder-77201544-c786-4c1d-bcd5-8c2eac399021-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Lock "cinder-77201544-c786-4c1d-bcd5-8c2eac399021-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Acquiring lock "cinder-quobyte-77201544-c786-4c1d-bcd5-8c2eac399021" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:16 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Lock "cinder-quobyte-77201544-c786-4c1d-bcd5-8c2eac399021" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:16 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf467507-5a5b-435b-9502-33073ac31f2d]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:41:16 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-77201544-c786-4c1d-bcd5-8c2eac399021 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:16 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-77201544-c786-4c1d-bcd5-8c2eac399021 Jul 23 22:41:16 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:17 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-77201544-c786-4c1d-bcd5-8c2eac399021" returned: 0 in 0.349s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-77201544-c786-4c1d-bcd5-8c2eac399021 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:17 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-77201544-c786-4c1d-bcd5-8c2eac399021 Jul 23 22:41:17 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:17 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-77201544-c786-4c1d-bcd5-8c2eac399021" returned: 0 in 0.244s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Lock "cinder-quobyte-77201544-c786-4c1d-bcd5-8c2eac399021" released by "delete_volume" :: held 0.631s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:17 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Created reservations ['1731a29e-ac26-47bb-ac9c-e0934da1bd00', 'c8f08ecd-09da-4b9d-b3ec-0d08ac900040', 'c1236672-1481-4bdf-ba92-06c1dee07a6c', '7e89bb4f-e4ca-424c-bfde-d2b189a4ebd1'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:41:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:41:17 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:41:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:17 devstack sudo[109399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:41:17 devstack sudo[109399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:17 devstack sudo[109399]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:17 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.261s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:17 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:41:17 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Deleted volume successfully. Jul 23 22:41:17 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-4e4cbb98-3697-40d3-a998-f1ebecbdd7b2 tempest-ProjectReaderTests-1898984603 None] Lock "cinder-77201544-c786-4c1d-bcd5-8c2eac399021-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:41:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 29 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:41:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 23 22:41:27 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:UPDATE=129,cinder:SELECT=109,cinder:INSERT=35,cinder:DELETE=9 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:41:27 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:UPDATE=131,cinder:DELETE=13,cinder:SELECT=85,cinder:INSERT=35 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Flow 'volume_create_manager' (0def2f1f-5572-4367-a61a-cfee1c2782d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572f739a-8c33-4d83-a1a6-212674004678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572f739a-8c33-4d83-a1a6-212674004678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-630529503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662fc3b0-5b1c-4faa-9865-4b27da9e0205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470d2da6c8ee4067aec307af04e69520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:41:40Z,use_quota=True,user_id='daaadf5a44134b26b7b16e176b83de9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df5677e-9303-4089-bc9d-2894c297cc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df5677e-9303-4089-bc9d-2894c297cc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824f21f8-a6d7-48d5-8b02-9d22c60f21e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824f21f8-a6d7-48d5-8b02-9d22c60f21e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662fc3b0-5b1c-4faa-9865-4b27da9e0205', 'volume_name': 'volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb3cb60-f89a-4dad-bbda-70aaef2c88c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb3cb60-f89a-4dad-bbda-70aaef2c88c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6b438e-0f5f-4896-bddc-0fa077d97ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:40 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Volume 662fc3b0-5b1c-4faa-9865-4b27da9e0205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205', 'volume_size': 1} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-630529503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662fc3b0-5b1c-4faa-9865-4b27da9e0205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470d2da6c8ee4067aec307af04e69520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:41:40Z,use_quota=True,user_id='daaadf5a44134b26b7b16e176b83de9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)}" {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Creating volume 662fc3b0-5b1c-4faa-9865-4b27da9e0205 {{(pid=88308) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:41:40 devstack cinder-volume[88308]: INFO cinder.volume.drivers.remotefs [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] casted to osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 1073741824 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:40 devstack sudo[109414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 1073741824 Jul 23 22:41:40 devstack sudo[109414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:40 devstack sudo[109414]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 1073741824" returned: 0 in 0.404s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:40 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:40 devstack sudo[109419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 Jul 23 22:41:40 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:41 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205" returned: 0 in 0.234s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'} {{(pid=88308) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 23 22:41:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6b438e-0f5f-4896-bddc-0fa077d97ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205', 'volume_size': 1}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7cf8146-bf3b-4d83-b9b4-f60b0f91cba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:41 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Volume volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 (662fc3b0-5b1c-4faa-9865-4b27da9e0205): created successfully Jul 23 22:41:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7cf8146-bf3b-4d83-b9b4-f60b0f91cba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:41 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Flow 'volume_create_manager' (0def2f1f-5572-4367-a61a-cfee1c2782d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:41:41 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-59b08be2-8cb9-4d66-bad2-247f4bbdb7c2 tempest-SnapshotDependencyTests-1405170134 None] Created volume successfully. Jul 23 22:41:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:41 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] Creating offline snapshot 9efccfe1-9651-4c07-b4dc-7b118f468eb8 of volume 662fc3b0-5b1c-4faa-9865-4b27da9e0205 {{(pid=88308) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 23 22:41:41 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1a14fd-91fe-4ac3-999c-dc37a31b1705]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:41:41 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:41 devstack sudo[109422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 Jul 23 22:41:41 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:42 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205" returned: 0 in 0.343s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 1G {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:42 devstack sudo[109427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 1G Jul 23 22:41:42 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:42 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 1G" returned: 0 in 0.388s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:42 devstack sudo[109432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 Jul 23 22:41:42 devstack sudo[109432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:42 devstack sudo[109432]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 -F qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8" returned: 0 in 0.296s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:42 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 is being set with open permissions: ugo+rw Jul 23 22:41:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:42 devstack sudo[109437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 Jul 23 22:41:42 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:42 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8" returned: 0 in 0.238s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:42 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:42 devstack sudo[109440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.info Jul 23 22:41:42 devstack sudo[109440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:43 devstack sudo[109440]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.info" returned: 0 in 0.240s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:43 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.info is being set with open permissions: ugo+rw Jul 23 22:41:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.info {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:43 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.info Jul 23 22:41:43 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:43 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.info" returned: 0 in 0.244s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:43 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:43 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-f312a4c2-fc72-4157-b615-10c592743608 tempest-SnapshotDependencyTests-1405170134 None] Create snapshot completed successfully Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88308) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Flow 'volume_create_manager' (09498c8b-bbfe-459e-aa85-a5c91adc3f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b19caef-6ffd-4eb2-aa5d-5ba0d8320132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b19caef-6ffd-4eb2-aa5d-5ba0d8320132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-23T20:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93e901c-651f-4782-8ff8-5dfa239eb49a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470d2da6c8ee4067aec307af04e69520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-23T20:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9efccfe1-9651-4c07-b4dc-7b118f468eb8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-23T20:41:44Z,use_quota=True,user_id='daaadf5a44134b26b7b16e176b83de9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d39f267-c061-409a-9016-89a595ea5f24),volume_type_id=1d39f267-c061-409a-9016-89a595ea5f24)' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b85015a-48c7-4295-a58d-0b6b5cfd587b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b85015a-48c7-4295-a58d-0b6b5cfd587b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3abbfff4-91cc-4e2d-85ec-3fa80232270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3abbfff4-91cc-4e2d-85ec-3fa80232270e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e93e901c-651f-4782-8ff8-5dfa239eb49a', 'volume_name': 'volume-e93e901c-651f-4782-8ff8-5dfa239eb49a', 'volume_size': 1, 'snapshot_id': '9efccfe1-9651-4c07-b4dc-7b118f468eb8'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b269985-27fb-4e61-9ea7-860bcd6c9a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b269985-27fb-4e61-9ea7-860bcd6c9a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdb25b4-e18f-4d99-ad91-2d69a5862db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:44 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Volume e93e901c-651f-4782-8ff8-5dfa239eb49a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e93e901c-651f-4782-8ff8-5dfa239eb49a', 'volume_size': 1, 'snapshot_id': '9efccfe1-9651-4c07-b4dc-7b118f468eb8'} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "cinder-quobyte-9efccfe1-9651-4c07-b4dc-7b118f468eb8-e93e901c-651f-4782-8ff8-5dfa239eb49a" by "_create_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-quobyte-9efccfe1-9651-4c07-b4dc-7b118f468eb8-e93e901c-651f-4782-8ff8-5dfa239eb49a" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Creating volume e93e901c-651f-4782-8ff8-5dfa239eb49a from snapshot 9efccfe1-9651-4c07-b4dc-7b118f468eb8 {{(pid=88308) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Selected osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190 as target Quobyte volume. {{(pid=88308) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "cinder-quobyte-e93e901c-651f-4782-8ff8-5dfa239eb49a" by "_copy_volume_from_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-quobyte-e93e901c-651f-4782-8ff8-5dfa239eb49a" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] snapshot: 9efccfe1-9651-4c07-b4dc-7b118f468eb8, volume: e93e901c-651f-4782-8ff8-5dfa239eb49a, {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c4eab3-8587-4e7d-b72c-53e67eaa9267]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:44 devstack sudo[109446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 Jul 23 22:41:44 devstack sudo[109446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:44 devstack sudo[109446]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8" returned: 0 in 0.349s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Creating direct copy from snapshot {{(pid=88308) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[04547582-2ad5-49d6-9a60-2e899adb34dd]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:41:44 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:44 devstack sudo[109451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 Jul 23 22:41:44 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:45 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205" returned: 0 in 0.344s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:45 devstack cinder-volume[88308]: DEBUG cinder.utils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Path /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e93e901c-651f-4782-8ff8-5dfa239eb49a not found in is_blk_device check {{(pid=88308) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 23 22:41:45 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e93e901c-651f-4782-8ff8-5dfa239eb49a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:45 devstack sudo[109456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e93e901c-651f-4782-8ff8-5dfa239eb49a Jul 23 22:41:45 devstack sudo[109456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:49 devstack sudo[109456]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e93e901c-651f-4782-8ff8-5dfa239eb49a" returned: 0 in 4.025s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:49 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3ea31f-d2ef-4473-949a-542ea718078e]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:41:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:49 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 Jul 23 22:41:49 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:49 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205" returned: 0 in 0.533s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:49 devstack cinder-volume[88308]: DEBUG cinder.image.image_utils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Image conversion details: src /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e93e901c-651f-4782-8ff8-5dfa239eb49a {{(pid=88308) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 23 22:41:49 devstack cinder-volume[88308]: INFO cinder.image.image_utils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Converted 1024.00 MB image at 254.31 MB/s Jul 23 22:41:49 devstack cinder-volume[88308]: WARNING cinder.volume.drivers.remotefs [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e93e901c-651f-4782-8ff8-5dfa239eb49a is being set with open permissions: ugo+rw Jul 23 22:41:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e93e901c-651f-4782-8ff8-5dfa239eb49a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:49 devstack sudo[109478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e93e901c-651f-4782-8ff8-5dfa239eb49a Jul 23 22:41:49 devstack sudo[109478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:49 devstack sudo[109478]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e93e901c-651f-4782-8ff8-5dfa239eb49a" returned: 0 in 0.241s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-quobyte-e93e901c-651f-4782-8ff8-5dfa239eb49a" released by "_copy_volume_from_snapshot" :: held 5.575s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:49 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-quobyte-9efccfe1-9651-4c07-b4dc-7b118f468eb8-e93e901c-651f-4782-8ff8-5dfa239eb49a" released by "_create_volume_from_snapshot" :: held 5.602s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:49 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.615s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdb25b4-e18f-4d99-ad91-2d69a5862db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93e901c-651f-4782-8ff8-5dfa239eb49a', 'volume_size': 1, 'snapshot_id': '9efccfe1-9651-4c07-b4dc-7b118f468eb8'}' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7831f8b8-3a03-4f0a-bd91-9b9bf2412ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 23 22:41:50 devstack cinder-volume[88308]: INFO cinder.volume.flows.manager.create_volume [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Volume volume-e93e901c-651f-4782-8ff8-5dfa239eb49a (e93e901c-651f-4782-8ff8-5dfa239eb49a): created successfully Jul 23 22:41:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7831f8b8-3a03-4f0a-bd91-9b9bf2412ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88308) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 23 22:41:50 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Flow 'volume_create_manager' (09498c8b-bbfe-459e-aa85-a5c91adc3f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88308) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 23 22:41:50 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c6b3eb84-67e5-42eb-a665-a4bb0d8c42cc tempest-SnapshotDependencyTests-1405170134 None] Created volume successfully. Jul 23 22:41:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "cinder-9efccfe1-9651-4c07-b4dc-7b118f468eb8-delete_snapshot" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-9efccfe1-9651-4c07-b4dc-7b118f468eb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "cinder-quobyte-662fc3b0-5b1c-4faa-9865-4b27da9e0205" by "delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-quobyte-662fc3b0-5b1c-4faa-9865-4b27da9e0205" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "cinder-quobyte-9efccfe1-9651-4c07-b4dc-7b118f468eb8" by "_delete_snapshot" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:50 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-quobyte-9efccfe1-9651-4c07-b4dc-7b118f468eb8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Deleting offline snapshot 9efccfe1-9651-4c07-b4dc-7b118f468eb8 of volume 662fc3b0-5b1c-4faa-9865-4b27da9e0205 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 23 22:41:50 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] snapshot_file for this snap is: volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 {{(pid=88308) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 23 22:41:50 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[37437961-3dc2-4a40-94f0-6984bee46185]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:41:50 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:51 devstack sudo[109481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 Jul 23 22:41:51 devstack sudo[109481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:51 devstack sudo[109481]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8" returned: 0 in 0.349s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:51 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.remotefs [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88308) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 23 22:41:51 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eab4e71-1092-4944-a4d1-36e9ccc9d0c1]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:41:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:51 devstack sudo[109486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 Jul 23 22:41:51 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:51 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205" returned: 0 in 0.345s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:51 devstack sudo[109491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 Jul 23 22:41:51 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:51 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8" returned: 0 in 0.328s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:51 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:51 devstack sudo[109496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8 Jul 23 22:41:51 devstack sudo[109496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:52 devstack sudo[109496]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:52 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205.9efccfe1-9651-4c07-b4dc-7b118f468eb8" returned: 0 in 0.243s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-quobyte-9efccfe1-9651-4c07-b4dc-7b118f468eb8" released by "_delete_snapshot" :: held 1.355s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-quobyte-662fc3b0-5b1c-4faa-9865-4b27da9e0205" released by "delete_snapshot" :: held 1.377s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:52 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Created reservations ['c63889a4-4e7a-4e6f-b7d7-5e1157da0834', '0df41ac7-6321-49a1-b505-7b8e9e39d1a8', '67b287f4-ec56-4d16-80c5-d7a600ceface', 'b3dbc2ae-d979-4e84-a44a-a99da75d7a84'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:41:52 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Delete snapshot completed successfully. Jul 23 22:41:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-79fa39d3-86ae-44b6-a3fd-cba473b6755b tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-9efccfe1-9651-4c07-b4dc-7b118f468eb8-delete_snapshot" released by "delete_snapshot" :: held 1.502s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:52 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "cinder-662fc3b0-5b1c-4faa-9865-4b27da9e0205-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-662fc3b0-5b1c-4faa-9865-4b27da9e0205-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "cinder-quobyte-662fc3b0-5b1c-4faa-9865-4b27da9e0205" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-quobyte-662fc3b0-5b1c-4faa-9865-4b27da9e0205" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:53 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2642ef9f-e794-4fd1-a757-12241153112c]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:41:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:53 devstack sudo[109499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 Jul 23 22:41:53 devstack sudo[109499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:53 devstack sudo[109499]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205" returned: 0 in 0.350s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:53 devstack sudo[109504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205 Jul 23 22:41:53 devstack sudo[109504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:53 devstack sudo[109504]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-662fc3b0-5b1c-4faa-9865-4b27da9e0205" returned: 0 in 0.241s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:53 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-quobyte-662fc3b0-5b1c-4faa-9865-4b27da9e0205" released by "delete_volume" :: held 0.647s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:53 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Created reservations ['8866d818-283d-432c-b85c-57321da62985', 'd97df718-7b98-4e51-8c80-c8aa1063db28', 'f46aaf12-aab2-4112-a46e-2002acd7807e', '0b7828a9-4a91-4f94-bdcf-b32f84b8c238'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:41:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:41:53 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:41:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:53 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:53 devstack sudo[109507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:41:53 devstack sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:54 devstack sudo[109507]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.238s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:41:54 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Deleted volume successfully. Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-a3e2c188-3d78-4a64-9f21-e1a6e0d89209 tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-662fc3b0-5b1c-4faa-9865-4b27da9e0205-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "cinder-e93e901c-651f-4782-8ff8-5dfa239eb49a-delete_volume" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-e93e901c-651f-4782-8ff8-5dfa239eb49a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "cinder-quobyte-e93e901c-651f-4782-8ff8-5dfa239eb49a" by "delete_volume" {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-quobyte-e93e901c-651f-4782-8ff8-5dfa239eb49a" acquired by "delete_volume" :: waited 0.014s {{(pid=88308) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0436ddd-b88a-413d-9eff-22654b7191ea]: (4, 'qcow2') {{(pid=89661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e93e901c-651f-4782-8ff8-5dfa239eb49a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:54 devstack sudo[109510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e93e901c-651f-4782-8ff8-5dfa239eb49a Jul 23 22:41:54 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:54 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e93e901c-651f-4782-8ff8-5dfa239eb49a" returned: 0 in 0.353s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e93e901c-651f-4782-8ff8-5dfa239eb49a {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:54 devstack sudo[109515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e93e901c-651f-4782-8ff8-5dfa239eb49a Jul 23 22:41:54 devstack sudo[109515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:54 devstack sudo[109515]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b/volume-e93e901c-651f-4782-8ff8-5dfa239eb49a" returned: 0 in 0.240s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-quobyte-e93e901c-651f-4782-8ff8-5dfa239eb49a" released by "delete_volume" :: held 0.633s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG cinder.quota [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Created reservations ['eb86a9d8-60e8-4e47-a667-44e06c75854b', '5eb643f5-f893-44b6-8cf5-5d9957990c28', '0d09f85a-6415-40ee-a3a5-16e2b7bcdbbd', '9d0b7589-af08-4ed9-906e-af5690ad5055'] {{(pid=88308) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:41:54 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:41:54 devstack sudo[109518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:41:54 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:41:55 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root Jul 23 22:41:55 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.242s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:41:55 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:41:55 devstack cinder-volume[88308]: INFO cinder.volume.manager [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Deleted volume successfully. Jul 23 22:41:55 devstack cinder-volume[88308]: DEBUG cinder.coordination [None req-c0e9134e-b675-4e34-89f0-b6db9eec0283 tempest-SnapshotDependencyTests-1405170134 None] Lock "cinder-e93e901c-651f-4782-8ff8-5dfa239eb49a-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=88308) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 23 22:42:04 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=27,cinder:UPDATE=29,cinder:DELETE=1,cinder:INSERT=4 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:42:05 devstack cinder-volume[88308]: DEBUG dbcounter [-] [88308] Writing DB stats cinder:SELECT=20,cinder:INSERT=10,cinder:UPDATE=27,cinder:DELETE=4 {{(pid=88308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 23 22:42:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:42:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 23 22:42:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 23 22:42:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190': None} {{(pid=88308) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 23 22:42:26 devstack cinder-volume[88308]: DEBUG cinder.volume.drivers.quobyte [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a2319c8c-33b9-46ad-ae4b-b4e8d7f12190'] {{(pid=88308) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 23 22:42:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.lockutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88308) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 23 22:42:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 23 22:42:26 devstack sudo[109823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b Jul 23 22:42:26 devstack sudo[109823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 23 22:42:26 devstack sudo[109823]: pam_unix(sudo:session): session closed for user root Jul 23 22:42:26 devstack cinder-volume[88308]: DEBUG oslo_concurrency.processutils [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9e9892ede05d61c5d5b98f922dffe32b" returned: 0 in 0.250s {{(pid=88308) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 23 22:42:26 devstack cinder-volume[88308]: DEBUG cinder.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Notifying Schedulers of capabilities ... {{(pid=88308) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 23 22:42:26 devstack cinder-volume[88308]: DEBUG oslo_service.periodic_task [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] Running periodic task VolumeManager._thread_info {{(pid=88308) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 23 22:42:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread count: 29 {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 23 22:42:26 devstack cinder-volume[88308]: DEBUG cinder.volume.manager [None req-5db41a53-68cd-4572-860d-df0b67bc0120 None None] thread info: [<_MainThread(MainThread, started 128020876533888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88308) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}